2023-02-13 21:53:00,590 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-13 21:53:00,840 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d 2023-02-13 21:53:00,853 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-13 21:53:00,853 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7, deleteOnExit=true 2023-02-13 21:53:00,853 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 21:53:00,854 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/test.cache.data in system properties and HBase conf 2023-02-13 21:53:00,855 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 21:53:00,855 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/hadoop.log.dir in system properties and HBase conf 2023-02-13 21:53:00,856 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 21:53:00,857 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 21:53:00,857 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 21:53:00,961 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 21:53:01,335 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 21:53:01,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 21:53:01,341 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 21:53:01,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 21:53:01,342 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 21:53:01,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 21:53:01,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 21:53:01,343 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 21:53:01,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 21:53:01,344 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 21:53:01,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/nfs.dump.dir in system properties and HBase conf 2023-02-13 21:53:01,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/java.io.tmpdir in system properties and HBase conf 2023-02-13 21:53:01,345 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 21:53:01,346 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 21:53:01,346 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 21:53:01,897 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 21:53:01,900 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 21:53:02,143 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 21:53:02,314 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 21:53:02,335 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 21:53:02,372 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 21:53:02,400 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/java.io.tmpdir/Jetty_localhost_localdomain_40593_hdfs____.89nt3n/webapp 2023-02-13 21:53:02,526 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:40593 2023-02-13 21:53:02,571 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 21:53:02,572 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 21:53:02,964 WARN [Listener at localhost.localdomain/38021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 21:53:03,109 WARN [Listener at localhost.localdomain/38021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 21:53:03,131 WARN [Listener at localhost.localdomain/38021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 21:53:03,137 INFO [Listener at localhost.localdomain/38021] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 21:53:03,143 INFO [Listener at localhost.localdomain/38021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/java.io.tmpdir/Jetty_localhost_36537_datanode____5pjwu5/webapp 2023-02-13 21:53:03,241 INFO [Listener at localhost.localdomain/38021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36537 2023-02-13 21:53:03,647 WARN [Listener at localhost.localdomain/39503] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 21:53:04,141 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd580c77da902981c: Processing first storage report for DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c from datanode bdf589dd-6236-4fca-a0bf-4d069f108059 2023-02-13 21:53:04,143 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd580c77da902981c: from storage DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c node DatanodeRegistration(127.0.0.1:40141, datanodeUuid=bdf589dd-6236-4fca-a0bf-4d069f108059, infoPort=45685, infoSecurePort=0, ipcPort=39503, storageInfo=lv=-57;cid=testClusterID;nsid=353953629;c=1676325181965), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-13 21:53:04,144 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd580c77da902981c: Processing first storage report for DS-8647a85e-f881-451e-adb4-3ad1740940d0 from datanode bdf589dd-6236-4fca-a0bf-4d069f108059 2023-02-13 21:53:04,144 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd580c77da902981c: from storage DS-8647a85e-f881-451e-adb4-3ad1740940d0 node DatanodeRegistration(127.0.0.1:40141, datanodeUuid=bdf589dd-6236-4fca-a0bf-4d069f108059, infoPort=45685, infoSecurePort=0, ipcPort=39503, storageInfo=lv=-57;cid=testClusterID;nsid=353953629;c=1676325181965), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 21:53:04,208 DEBUG [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d 2023-02-13 21:53:04,270 INFO [Listener at localhost.localdomain/39503] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/zookeeper_0, clientPort=60489, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 21:53:04,284 INFO [Listener at localhost.localdomain/39503] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60489 2023-02-13 21:53:04,292 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:04,294 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:04,950 INFO [Listener at localhost.localdomain/39503] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9 with version=8 2023-02-13 21:53:04,951 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/hbase-staging 2023-02-13 21:53:05,233 INFO [Listener at localhost.localdomain/39503] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 21:53:05,631 INFO [Listener at localhost.localdomain/39503] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-02-13 21:53:05,669 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:05,669 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:05,669 INFO [Listener at localhost.localdomain/39503] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 21:53:05,670 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:05,670 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 21:53:05,787 INFO [Listener at localhost.localdomain/39503] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 21:53:05,856 DEBUG [Listener at localhost.localdomain/39503] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 21:53:05,937 INFO [Listener at localhost.localdomain/39503] ipc.NettyRpcServer(120): Bind to /148.251.75.209:37155 2023-02-13 21:53:05,945 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:05,947 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:05,964 INFO [Listener at localhost.localdomain/39503] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37155 connecting to ZooKeeper ensemble=127.0.0.1:60489 2023-02-13 21:53:05,996 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:371550x0, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 21:53:05,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:37155-0x1015dd424a70000 connected 2023-02-13 21:53:06,020 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 21:53:06,021 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 21:53:06,024 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 21:53:06,030 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37155 2023-02-13 21:53:06,031 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37155 2023-02-13 21:53:06,031 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37155 2023-02-13 21:53:06,035 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37155 2023-02-13 21:53:06,035 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37155 2023-02-13 21:53:06,040 INFO [Listener at localhost.localdomain/39503] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9, hbase.cluster.distributed=false 2023-02-13 21:53:06,102 INFO [Listener at localhost.localdomain/39503] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-02-13 21:53:06,102 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:06,102 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:06,102 INFO [Listener at localhost.localdomain/39503] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 21:53:06,103 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 21:53:06,103 INFO [Listener at localhost.localdomain/39503] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 21:53:06,107 INFO [Listener at localhost.localdomain/39503] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 21:53:06,110 INFO [Listener at localhost.localdomain/39503] ipc.NettyRpcServer(120): Bind to /148.251.75.209:34815 2023-02-13 21:53:06,112 INFO [Listener at localhost.localdomain/39503] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 21:53:06,117 DEBUG [Listener at localhost.localdomain/39503] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 21:53:06,118 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:06,120 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:06,122 INFO [Listener at localhost.localdomain/39503] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34815 connecting to ZooKeeper ensemble=127.0.0.1:60489 2023-02-13 21:53:06,125 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:348150x0, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 21:53:06,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34815-0x1015dd424a70001 connected 2023-02-13 21:53:06,126 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 21:53:06,127 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 21:53:06,128 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 21:53:06,128 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34815 2023-02-13 21:53:06,128 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34815 2023-02-13 21:53:06,129 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34815 2023-02-13 21:53:06,129 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34815 2023-02-13 21:53:06,131 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34815 2023-02-13 21:53:06,132 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:06,144 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 21:53:06,145 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:06,162 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 21:53:06,162 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 21:53:06,162 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:06,163 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 21:53:06,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,37155,1676325185079 from backup master directory 2023-02-13 21:53:06,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 21:53:06,166 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:06,166 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 21:53:06,167 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 21:53:06,167 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:06,169 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 21:53:06,171 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 21:53:06,254 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/hbase.id with ID: e0ee2855-45c3-4b5a-8a03-3118b0e20e56 2023-02-13 21:53:06,301 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:06,319 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:06,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2fba7cf7 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:06,384 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@433c113e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:06,410 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 21:53:06,412 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 21:53:06,430 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 21:53:06,430 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 21:53:06,433 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 21:53:06,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 21:53:06,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 21:53:06,470 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store-tmp 2023-02-13 21:53:06,897 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:06,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 21:53:06,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:53:06,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:53:06,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 21:53:06,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:53:06,898 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:53:06,899 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676325186897Disabling compacts and flushes for region at 1676325186898 (+1 ms)Disabling writes for close at 1676325186898Writing region close event to WAL at 1676325186898Closed at 1676325186898 2023-02-13 21:53:06,901 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/WALs/jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:06,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C37155%2C1676325185079, suffix=, logDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/WALs/jenkins-hbase20.apache.org,37155,1676325185079, archiveDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/oldWALs, maxLogs=10 2023-02-13 21:53:06,985 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK] 2023-02-13 21:53:06,992 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 21:53:07,053 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/WALs/jenkins-hbase20.apache.org,37155,1676325185079/jenkins-hbase20.apache.org%2C37155%2C1676325185079.1676325186935 2023-02-13 21:53:07,054 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK]] 2023-02-13 21:53:07,055 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:07,055 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:07,058 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,059 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,116 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,123 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 21:53:07,145 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 21:53:07,157 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:07,163 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,185 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 21:53:07,190 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:07,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66532596, jitterRate=-0.008587062358856201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:07,191 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676325187086Initializing all the Stores at 1676325187088 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676325187088Cleaning up temporary data from old regions at 1676325187171 (+83 ms)Cleaning up detritus from prior splits at 1676325187172 (+1 ms)Region opened successfully at 1676325187191 (+19 ms) 2023-02-13 21:53:07,193 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 21:53:07,217 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 21:53:07,218 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 21:53:07,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 21:53:07,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 21:53:07,260 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-02-13 21:53:07,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 21:53:07,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 21:53:07,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 21:53:07,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 21:53:07,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 21:53:07,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 21:53:07,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 21:53:07,345 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 21:53:07,348 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:07,350 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 21:53:07,350 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 21:53:07,364 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 21:53:07,368 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 21:53:07,368 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 21:53:07,368 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:07,369 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,37155,1676325185079, sessionid=0x1015dd424a70000, setting cluster-up flag (Was=false) 2023-02-13 21:53:07,383 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:07,387 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 21:53:07,388 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:07,393 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:07,397 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 21:53:07,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:07,404 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp 2023-02-13 21:53:07,436 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(952): ClusterId : e0ee2855-45c3-4b5a-8a03-3118b0e20e56 2023-02-13 21:53:07,443 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 21:53:07,452 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 21:53:07,452 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 21:53:07,469 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 21:53:07,470 DEBUG [RS:0;jenkins-hbase20:34815] zookeeper.ReadOnlyZKClient(139): Connect 0x061299f7 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:07,495 DEBUG [RS:0;jenkins-hbase20:34815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8d56745, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:07,495 DEBUG [RS:0;jenkins-hbase20:34815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ceaf287, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 21:53:07,526 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:34815 2023-02-13 21:53:07,530 INFO [RS:0;jenkins-hbase20:34815] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 21:53:07,530 INFO [RS:0;jenkins-hbase20:34815] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 21:53:07,530 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 21:53:07,533 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,37155,1676325185079 with isa=jenkins-hbase20.apache.org/148.251.75.209:34815, startcode=1676325186101 2023-02-13 21:53:07,550 DEBUG [RS:0;jenkins-hbase20:34815] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 21:53:07,555 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 21:53:07,568 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 21:53:07,569 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676325217581 2023-02-13 21:53:07,583 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 21:53:07,590 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 21:53:07,591 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 21:53:07,600 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 21:53:07,600 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 21:53:07,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 21:53:07,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 21:53:07,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 21:53:07,621 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 21:53:07,622 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,623 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 21:53:07,625 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 21:53:07,626 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 21:53:07,629 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52953, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 21:53:07,631 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 21:53:07,632 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 21:53:07,634 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676325187634,5,FailOnTimeoutGroup] 2023-02-13 21:53:07,637 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676325187635,5,FailOnTimeoutGroup] 2023-02-13 21:53:07,638 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,638 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 21:53:07,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,642 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,660 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9 2023-02-13 21:53:07,660 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:38021 2023-02-13 21:53:07,660 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 21:53:07,664 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 21:53:07,665 DEBUG [RS:0;jenkins-hbase20:34815] zookeeper.ZKUtil(162): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,665 WARN [RS:0;jenkins-hbase20:34815] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 21:53:07,666 INFO [RS:0;jenkins-hbase20:34815] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 21:53:07,666 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/WALs/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,667 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,34815,1676325186101] 2023-02-13 21:53:07,676 DEBUG [RS:0;jenkins-hbase20:34815] zookeeper.ZKUtil(162): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,686 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 21:53:07,696 INFO [RS:0;jenkins-hbase20:34815] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 21:53:07,716 INFO [RS:0;jenkins-hbase20:34815] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 21:53:07,719 INFO [RS:0;jenkins-hbase20:34815] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:53:07,719 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,720 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 21:53:07,728 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,729 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,729 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,730 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,730 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,730 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,730 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-13 21:53:07,730 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,731 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,731 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,731 DEBUG [RS:0;jenkins-hbase20:34815] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-13 21:53:07,732 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,733 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,733 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,748 INFO [RS:0;jenkins-hbase20:34815] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 21:53:07,751 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,34815,1676325186101-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:07,769 INFO [RS:0;jenkins-hbase20:34815] regionserver.Replication(203): jenkins-hbase20.apache.org,34815,1676325186101 started 2023-02-13 21:53:07,770 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,34815,1676325186101, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:34815, sessionid=0x1015dd424a70001 2023-02-13 21:53:07,770 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 21:53:07,770 DEBUG [RS:0;jenkins-hbase20:34815] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,770 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34815,1676325186101' 2023-02-13 21:53:07,770 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,34815,1676325186101' 2023-02-13 21:53:07,771 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 21:53:07,772 DEBUG [RS:0;jenkins-hbase20:34815] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 21:53:07,772 DEBUG [RS:0;jenkins-hbase20:34815] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 21:53:07,772 INFO [RS:0;jenkins-hbase20:34815] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 21:53:07,772 INFO [RS:0;jenkins-hbase20:34815] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 21:53:07,888 INFO [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34815%2C1676325186101, suffix=, logDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/WALs/jenkins-hbase20.apache.org,34815,1676325186101, archiveDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/oldWALs, maxLogs=32 2023-02-13 21:53:07,904 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK] 2023-02-13 21:53:07,908 INFO [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/WALs/jenkins-hbase20.apache.org,34815,1676325186101/jenkins-hbase20.apache.org%2C34815%2C1676325186101.1676325187890 2023-02-13 21:53:07,909 DEBUG [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK]] 2023-02-13 21:53:08,048 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:08,049 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:08,050 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9 2023-02-13 21:53:08,063 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:08,065 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 21:53:08,068 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/info 2023-02-13 21:53:08,069 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 21:53:08,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,070 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 21:53:08,073 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/rep_barrier 2023-02-13 21:53:08,073 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 21:53:08,074 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,075 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 21:53:08,077 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/table 2023-02-13 21:53:08,078 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 21:53:08,079 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,081 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740 2023-02-13 21:53:08,082 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740 2023-02-13 21:53:08,085 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 21:53:08,086 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 21:53:08,089 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:08,090 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69836992, jitterRate=0.04065227508544922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 21:53:08,090 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676325188063Initializing all the Stores at 1676325188064 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676325188065 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676325188065Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676325188065Cleaning up temporary data from old regions at 1676325188083 (+18 ms)Cleaning up detritus from prior splits at 1676325188084 (+1 ms)Region opened successfully at 1676325188090 (+6 ms) 2023-02-13 21:53:08,090 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 21:53:08,091 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 21:53:08,091 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 21:53:08,091 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 21:53:08,091 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 21:53:08,091 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 21:53:08,092 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676325188090Disabling compacts and flushes for region at 1676325188090Disabling writes for close at 1676325188091 (+1 ms)Writing region close event to WAL at 1676325188091Closed at 1676325188091 2023-02-13 21:53:08,095 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 21:53:08,096 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 21:53:08,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 21:53:08,112 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 21:53:08,115 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 21:53:08,267 DEBUG [jenkins-hbase20:37155] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-13 21:53:08,270 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34815,1676325186101, state=OPENING 2023-02-13 21:53:08,276 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 21:53:08,277 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:08,278 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 21:53:08,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:08,464 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:08,466 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 21:53:08,469 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42096, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 21:53:08,480 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 21:53:08,481 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 21:53:08,484 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C34815%2C1676325186101.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/WALs/jenkins-hbase20.apache.org,34815,1676325186101, archiveDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/oldWALs, maxLogs=32 2023-02-13 21:53:08,501 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK] 2023-02-13 21:53:08,505 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/WALs/jenkins-hbase20.apache.org,34815,1676325186101/jenkins-hbase20.apache.org%2C34815%2C1676325186101.meta.1676325188486.meta 2023-02-13 21:53:08,506 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40141,DS-b9d363b0-b4bb-478a-ac2a-73a9aff2580c,DISK]] 2023-02-13 21:53:08,506 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:08,508 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 21:53:08,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 21:53:08,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 21:53:08,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 21:53:08,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:08,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 21:53:08,536 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 21:53:08,538 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 21:53:08,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/info 2023-02-13 21:53:08,540 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/info 2023-02-13 21:53:08,541 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 21:53:08,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 21:53:08,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/rep_barrier 2023-02-13 21:53:08,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/rep_barrier 2023-02-13 21:53:08,544 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 21:53:08,545 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 21:53:08,547 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/table 2023-02-13 21:53:08,548 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/table 2023-02-13 21:53:08,548 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 21:53:08,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:08,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740 2023-02-13 21:53:08,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740 2023-02-13 21:53:08,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 21:53:08,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 21:53:08,560 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66063286, jitterRate=-0.015580326318740845}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 21:53:08,560 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676325188536Writing region info on filesystem at 1676325188536Initializing all the Stores at 1676325188538 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676325188538Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676325188538Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676325188538Cleaning up temporary data from old regions at 1676325188555 (+17 ms)Cleaning up detritus from prior splits at 1676325188556 (+1 ms)Running coprocessor post-open hooks at 1676325188560 (+4 ms)Region opened successfully at 1676325188560 2023-02-13 21:53:08,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676325188458 2023-02-13 21:53:08,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 21:53:08,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 21:53:08,589 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,34815,1676325186101, state=OPEN 2023-02-13 21:53:08,591 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 21:53:08,591 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 21:53:08,595 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 21:53:08,596 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,34815,1676325186101 in 310 msec 2023-02-13 21:53:08,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 21:53:08,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 495 msec 2023-02-13 21:53:08,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1360 sec 2023-02-13 21:53:08,606 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676325186159, completionTime=-1 2023-02-13 21:53:08,606 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-13 21:53:08,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 21:53:08,665 DEBUG [hconnection-0x13532937-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:08,668 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:08,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-13 21:53:08,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676325248687 2023-02-13 21:53:08,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676325308687 2023-02-13 21:53:08,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 80 msec 2023-02-13 21:53:08,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37155,1676325185079-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:08,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37155,1676325185079-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:08,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37155,1676325185079-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:08,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:37155, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:08,714 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 21:53:08,721 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 21:53:08,729 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 21:53:08,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 21:53:08,740 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 21:53:08,742 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:08,745 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:08,763 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:08,766 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5 empty. 2023-02-13 21:53:08,767 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:08,767 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 21:53:09,189 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:09,192 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d553f6c4f5c52667324da766ddff8dd5, NAME => 'hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:09,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:09,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d553f6c4f5c52667324da766ddff8dd5, disabling compactions & flushes 2023-02-13 21:53:09,205 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. after waiting 0 ms 2023-02-13 21:53:09,206 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,206 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,206 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d553f6c4f5c52667324da766ddff8dd5: Waiting for close lock at 1676325189205Disabling compacts and flushes for region at 1676325189205Disabling writes for close at 1676325189206 (+1 ms)Writing region close event to WAL at 1676325189206Closed at 1676325189206 2023-02-13 21:53:09,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:09,224 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676325189214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325189214"}]},"ts":"1676325189214"} 2023-02-13 21:53:09,254 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:53:09,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:09,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325189256"}]},"ts":"1676325189256"} 2023-02-13 21:53:09,266 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 21:53:09,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d553f6c4f5c52667324da766ddff8dd5, ASSIGN}] 2023-02-13 21:53:09,276 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d553f6c4f5c52667324da766ddff8dd5, ASSIGN 2023-02-13 21:53:09,278 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d553f6c4f5c52667324da766ddff8dd5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:09,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d553f6c4f5c52667324da766ddff8dd5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:09,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676325189429"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325189429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325189429"}]},"ts":"1676325189429"} 2023-02-13 21:53:09,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d553f6c4f5c52667324da766ddff8dd5, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:09,603 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d553f6c4f5c52667324da766ddff8dd5, NAME => 'hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:09,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:09,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,608 INFO [StoreOpener-d553f6c4f5c52667324da766ddff8dd5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,610 DEBUG [StoreOpener-d553f6c4f5c52667324da766ddff8dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/info 2023-02-13 21:53:09,610 DEBUG [StoreOpener-d553f6c4f5c52667324da766ddff8dd5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/info 2023-02-13 21:53:09,611 INFO [StoreOpener-d553f6c4f5c52667324da766ddff8dd5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d553f6c4f5c52667324da766ddff8dd5 columnFamilyName info 2023-02-13 21:53:09,612 INFO [StoreOpener-d553f6c4f5c52667324da766ddff8dd5-1] regionserver.HStore(310): Store=d553f6c4f5c52667324da766ddff8dd5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:09,614 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:53:09,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:09,626 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d553f6c4f5c52667324da766ddff8dd5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64233139, jitterRate=-0.04285164177417755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:09,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d553f6c4f5c52667324da766ddff8dd5: Running coprocessor pre-open hook at 1676325189606Writing region info on filesystem at 1676325189606Initializing all the Stores at 1676325189607 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676325189608 (+1 ms)Cleaning up temporary data from old regions at 1676325189616 (+8 ms)Cleaning up detritus from prior splits at 1676325189617 (+1 ms)Running coprocessor post-open hooks at 1676325189627 (+10 ms)Region opened successfully at 1676325189627 2023-02-13 21:53:09,631 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5., pid=6, masterSystemTime=1676325189592 2023-02-13 21:53:09,635 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:53:09,637 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d553f6c4f5c52667324da766ddff8dd5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:09,637 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676325189636"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325189636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325189636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325189636"}]},"ts":"1676325189636"} 2023-02-13 21:53:09,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 21:53:09,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d553f6c4f5c52667324da766ddff8dd5, server=jenkins-hbase20.apache.org,34815,1676325186101 in 205 msec 2023-02-13 21:53:09,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 21:53:09,650 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d553f6c4f5c52667324da766ddff8dd5, ASSIGN in 373 msec 2023-02-13 21:53:09,651 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:09,651 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325189651"}]},"ts":"1676325189651"} 2023-02-13 21:53:09,654 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 21:53:09,656 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:09,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 925 msec 2023-02-13 21:53:09,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 21:53:09,751 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 21:53:09,752 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:53:09,795 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 21:53:09,813 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 21:53:09,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-02-13 21:53:09,829 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 21:53:09,842 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 21:53:09,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-02-13 21:53:09,860 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 21:53:09,862 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 21:53:09,863 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.695sec 2023-02-13 21:53:09,864 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 21:53:09,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 21:53:09,866 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 21:53:09,867 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37155,1676325185079-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 21:53:09,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,37155,1676325185079-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 21:53:09,881 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 21:53:09,945 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(139): Connect 0x0bf9b76d to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:09,949 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@557683e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:09,960 DEBUG [hconnection-0x4a51814c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:09,971 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:09,979 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:53:09,980 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(139): Connect 0x37d84738 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:09,983 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d5617ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:09,984 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:53:10,002 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=165, AvailableMemoryMB=7460 2023-02-13 21:53:10,012 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:10,016 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33462, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:10,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:53:10,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:10,031 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:10,033 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:10,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-13 21:53:10,037 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:10,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 empty. 2023-02-13 21:53:10,040 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:10,040 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-13 21:53:10,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:10,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:10,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:10,461 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:10,464 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => c5b526e37197c4eeeba0cee7de56cfa6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:10,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:10,882 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:10,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing c5b526e37197c4eeeba0cee7de56cfa6, disabling compactions & flushes 2023-02-13 21:53:10,883 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:10,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:10,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. after waiting 0 ms 2023-02-13 21:53:10,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:10,883 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:10,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for c5b526e37197c4eeeba0cee7de56cfa6: Waiting for close lock at 1676325190882Disabling compacts and flushes for region at 1676325190882Disabling writes for close at 1676325190883 (+1 ms)Writing region close event to WAL at 1676325190883Closed at 1676325190883 2023-02-13 21:53:10,888 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:10,889 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325190889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325190889"}]},"ts":"1676325190889"} 2023-02-13 21:53:10,892 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:53:10,894 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:10,894 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325190894"}]},"ts":"1676325190894"} 2023-02-13 21:53:10,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-13 21:53:10,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, ASSIGN}] 2023-02-13 21:53:10,914 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, ASSIGN 2023-02-13 21:53:10,916 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:11,068 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:11,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325191068"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325191068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325191068"}]},"ts":"1676325191068"} 2023-02-13 21:53:11,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:11,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:11,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:11,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5b526e37197c4eeeba0cee7de56cfa6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:11,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:11,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,240 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,243 DEBUG [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:11,243 DEBUG [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:11,246 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5b526e37197c4eeeba0cee7de56cfa6 columnFamilyName family1 2023-02-13 21:53:11,249 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] regionserver.HStore(310): Store=c5b526e37197c4eeeba0cee7de56cfa6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:11,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:11,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:11,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened c5b526e37197c4eeeba0cee7de56cfa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59084985, jitterRate=-0.11956511437892914}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:11,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for c5b526e37197c4eeeba0cee7de56cfa6: Running coprocessor pre-open hook at 1676325191235Writing region info on filesystem at 1676325191235Initializing all the Stores at 1676325191236 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325191236Cleaning up temporary data from old regions at 1676325191254 (+18 ms)Cleaning up detritus from prior splits at 1676325191255 (+1 ms)Running coprocessor post-open hooks at 1676325191270 (+15 ms)Region opened successfully at 1676325191270 2023-02-13 21:53:11,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., pid=11, masterSystemTime=1676325191226 2023-02-13 21:53:11,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:11,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:11,275 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:11,277 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325191275"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325191275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325191275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325191275"}]},"ts":"1676325191275"} 2023-02-13 21:53:11,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 21:53:11,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101 in 209 msec 2023-02-13 21:53:11,289 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-13 21:53:11,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, ASSIGN in 384 msec 2023-02-13 21:53:11,291 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:11,291 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325191291"}]},"ts":"1676325191291"} 2023-02-13 21:53:11,294 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-13 21:53:11,297 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:11,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2700 sec 2023-02-13 21:53:12,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-13 21:53:12,171 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-13 21:53:12,191 DEBUG [hconnection-0x356b5669-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:12,194 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:12,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:12,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,335 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:12,335 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:12,335 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:12,335 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:12,336 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,336 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,337 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:12,337 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:12,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:12,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:12,338 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:12,338 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:12,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:12,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:12,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:12,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:12,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:12,342 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:12,342 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:12,342 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:12,342 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:12,343 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:53:12,887 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e9ac8f75cbd44e5dafbe0cb6ddd74586 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e9ac8f75cbd44e5dafbe0cb6ddd74586 2023-02-13 21:53:13,301 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/dd45cc16479644c7acc05d60d7357f3a 2023-02-13 21:53:13,313 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/dd45cc16479644c7acc05d60d7357f3a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a 2023-02-13 21:53:13,324 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-13 21:53:13,327 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 983ms, sequenceid=5, compaction requested=false 2023-02-13 21:53:13,328 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:13,332 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:13,332 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:13,332 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:13,333 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:13,333 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,333 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:13,333 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:13,335 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,335 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,335 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,335 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:13,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:13,337 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:13,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f6bae96[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:13,337 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,339 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:13,339 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,339 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:13,339 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:13,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:13,341 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,341 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:13,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:13,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:13,345 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:13,345 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:13,345 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:13,345 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,345 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:13,347 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,347 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,348 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:13,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:13,349 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,351 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,359 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:13,359 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:13,359 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:13,359 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:13,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:13,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:13,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:13,359 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,360 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,360 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,360 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,360 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,360 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:13,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:13,362 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:13,362 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:13,462 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:13,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:13,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:13,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:13,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,483 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:13,483 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:13,484 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:13,484 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:13,485 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,485 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,486 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:13,486 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:13,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:13,486 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,486 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:13,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:13,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,487 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,488 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:13,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,488 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:13,488 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:13,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:13,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:13,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:13,489 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:13,489 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:13,489 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:53:13,934 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285e9f499c6b154ad1ae4d79e5235adbd9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285e9f499c6b154ad1ae4d79e5235adbd9 2023-02-13 21:53:13,948 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/4ae20363eee74dc4995b26d633a51a76 2023-02-13 21:53:13,959 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/4ae20363eee74dc4995b26d633a51a76 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76 2023-02-13 21:53:13,967 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:53:13,969 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 480ms, sequenceid=9, compaction requested=false 2023-02-13 21:53:13,969 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:13,969 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:13,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:13,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:13,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:13,971 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,971 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,972 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,972 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:13,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3b6f1e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:13,974 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:13,974 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,974 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:13,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:13,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:13,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:13,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:13,978 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:13,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:13,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:13,983 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:13,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:13,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:13,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,983 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:13,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:13,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:13,986 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:13,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,988 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:13,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,992 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,992 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,992 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:13,992 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:13,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:13,992 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:13,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:13,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:13,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:13,993 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:13,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:13,993 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:13,994 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:13,994 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:13,994 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:13,994 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:14,058 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:53:14,094 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:14,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:14,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:14,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:14,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,136 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:14,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:14,137 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:14,137 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:14,139 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,139 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,140 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,140 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:14,140 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,140 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,141 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,142 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:14,142 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:14,142 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:14,143 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:14,143 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:14,143 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:14,143 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:14,143 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:14,150 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 21:53:14,152 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 21:53:14,172 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201337a9ce7dcaf44d381af97cc988d0a9b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201337a9ce7dcaf44d381af97cc988d0a9b 2023-02-13 21:53:14,185 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/019a81ef1c7d4ea3956440a6cc0614cd 2023-02-13 21:53:14,194 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/019a81ef1c7d4ea3956440a6cc0614cd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd 2023-02-13 21:53:14,203 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 21:53:14,204 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 61ms, sequenceid=13, compaction requested=true 2023-02-13 21:53:14,204 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:14,204 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:14,204 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:14,204 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:14,204 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,204 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:14,205 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:14,206 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,206 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:14,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:14,207 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,207 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:14,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:14,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:14,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:14,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b429ab1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:14,209 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:14,209 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,210 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,210 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:14,210 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:14,210 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:14,210 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,210 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:14,211 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,211 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:14,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,211 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:14,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:14,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:14,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:14,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:14,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:14,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:14,216 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:14,216 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:14,216 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:14,216 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,216 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:14,217 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,217 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:14,217 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:14,218 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:14,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,220 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:14,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,226 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,226 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,226 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:14,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:14,226 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:14,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:14,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:14,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:14,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:14,228 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:14,228 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:14,228 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:14,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:14,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:14,328 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:14,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:14,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:14,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:14,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,345 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:14,345 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:14,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:14,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:14,347 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,347 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,348 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:14,348 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:14,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:14,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,349 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:14,349 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:14,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:14,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,350 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:14,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:14,350 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:14,350 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:14,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:14,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:14,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:14,351 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:14,351 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:14,351 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:14,783 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120523ae5468ff164e0b8f2f273fb306fe00 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120523ae5468ff164e0b8f2f273fb306fe00 2023-02-13 21:53:15,201 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e 2023-02-13 21:53:15,213 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e 2023-02-13 21:53:15,223 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 21:53:15,224 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 873ms, sequenceid=17, compaction requested=true 2023-02-13 21:53:15,224 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:15,224 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:15,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:15,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:15,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:15,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:15,227 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,227 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:15,227 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,227 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:15,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:15,228 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 21:53:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:15,228 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 21:53:15,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:15,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@428fe783[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:15,229 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:15,229 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,229 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:15,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:15,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:15,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:15,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:15,231 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:15,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:15,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:15,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:15,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:15,235 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:15,235 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:15,235 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:15,235 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,235 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:15,239 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,239 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,239 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:15,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:15,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,241 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:15,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:15,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:15,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:15,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:15,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:15,251 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:15,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:15,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:15,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:15,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,252 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:15,353 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:15,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:15,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,365 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:15,365 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:15,365 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:15,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:15,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,367 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,367 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:15,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:15,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:15,367 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:15,367 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:15,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,368 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,369 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:15,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:15,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:15,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:15,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:15,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:15,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:15,369 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:15,370 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:15,370 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:15,793 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283c3803fdd843479c87a7e45e9f673faa to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283c3803fdd843479c87a7e45e9f673faa 2023-02-13 21:53:16,207 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/42a990e11a6940398ad5ef0e13b6af34 2023-02-13 21:53:16,221 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/42a990e11a6940398ad5ef0e13b6af34 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34 2023-02-13 21:53:16,229 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 21:53:16,230 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 860ms, sequenceid=21, compaction requested=true 2023-02-13 21:53:16,230 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:16,230 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:16,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:16,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:16,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:16,230 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:16,233 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,233 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:16,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:16,233 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,233 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:16,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:16,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:16,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:16,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:16,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5002fe5a[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:16,235 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:16,235 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,236 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:16,236 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:16,236 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:16,236 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,236 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:16,237 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,237 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:16,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:16,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:16,237 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:16,237 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:16,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:16,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:16,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:16,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:16,240 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:16,240 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:16,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:16,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:16,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,240 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:16,241 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,241 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:16,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:16,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,241 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:16,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:16,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:16,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:16,242 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:16,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,243 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:16,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:16,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:16,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:16,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:16,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:16,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:16,245 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,246 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,246 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:16,246 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:16,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:16,246 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:16,346 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:16,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:16,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:16,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:16,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,360 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:16,360 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:16,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:16,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:16,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,362 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,362 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:16,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:16,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:16,363 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:16,363 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:16,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:16,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:16,364 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:16,364 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:16,364 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:16,364 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:16,364 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:16,364 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:16,364 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:16,365 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:16,785 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c5363b8510664125b52a77b1a8d87cca to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5363b8510664125b52a77b1a8d87cca 2023-02-13 21:53:17,196 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/e367bc12816542bdb8942ebb0d2d931b 2023-02-13 21:53:17,207 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/e367bc12816542bdb8942ebb0d2d931b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b 2023-02-13 21:53:17,216 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 21:53:17,218 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 853ms, sequenceid=25, compaction requested=true 2023-02-13 21:53:17,218 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:17,219 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:17,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:17,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:17,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:17,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:17,221 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:17,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@203128db[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:17,222 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:17,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,223 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:17,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:17,224 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,224 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:17,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:17,225 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:17,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:17,225 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:17,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:17,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:17,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:17,228 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:17,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:17,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:17,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,228 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:17,230 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:17,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:17,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:17,231 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,231 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:17,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,232 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:17,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,242 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,243 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:17,243 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:17,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:17,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:17,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:17,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:17,243 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:17,243 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,244 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:17,344 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:17,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:17,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:17,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:17,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,356 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:17,356 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:17,356 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:17,357 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:17,357 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,357 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,358 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,358 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:17,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:17,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:17,359 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:17,359 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:17,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:17,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,361 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:17,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:17,361 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:17,361 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:17,361 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:17,361 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:17,361 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:17,361 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:17,361 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:17,362 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:17,791 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101bfbbe1e4c12a4bda90162812407067a2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bfbbe1e4c12a4bda90162812407067a2 2023-02-13 21:53:18,201 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/3b0787f172044d06a68c902a5a12ff8e 2023-02-13 21:53:18,211 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/3b0787f172044d06a68c902a5a12ff8e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e 2023-02-13 21:53:18,221 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 21:53:18,223 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 861ms, sequenceid=29, compaction requested=true 2023-02-13 21:53:18,223 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:18,223 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:18,223 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:18,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:18,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:18,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:18,226 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:18,226 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:18,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:18,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f89a97e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:18,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:18,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,239 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,239 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:18,239 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:18,239 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:18,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,240 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:18,242 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:18,242 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:18,242 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,242 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:18,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:18,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:18,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:18,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:18,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:18,249 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:18,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:18,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:18,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,249 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:18,256 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,256 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,256 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:18,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:18,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:18,257 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:18,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,258 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,269 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,269 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:18,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:18,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:18,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:18,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:18,269 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:18,269 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:18,269 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,270 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:18,370 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:18,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:18,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:18,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:18,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,391 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:18,391 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:18,391 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:18,391 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:18,392 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,392 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,393 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:18,393 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:18,393 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:18,393 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,394 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:18,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:18,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:18,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:18,395 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:18,395 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:18,395 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:18,395 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:18,395 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:18,395 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:18,823 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b4202129932e4272bbf5fd26e533a3bf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b4202129932e4272bbf5fd26e533a3bf 2023-02-13 21:53:19,234 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/20df83a4284b48e39e14b2e4a823642e 2023-02-13 21:53:19,248 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/20df83a4284b48e39e14b2e4a823642e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e 2023-02-13 21:53:19,257 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 21:53:19,258 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 863ms, sequenceid=33, compaction requested=true 2023-02-13 21:53:19,258 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:19,258 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:19,258 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:19,313 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,313 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:19,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:19,314 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,315 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:19,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:19,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:19,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:19,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:19,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3287e4f3[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:19,322 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:19,322 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,411 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,411 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:19,411 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:19,412 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:19,412 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,412 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:19,414 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:19,414 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,414 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:19,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:19,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:19,414 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:19,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:19,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:19,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:19,422 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:19,422 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:19,423 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:19,423 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,423 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:19,424 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,424 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:19,424 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:19,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,425 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:19,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:19,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,425 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,427 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,427 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,427 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,427 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:19,427 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:19,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:19,427 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:19,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:19,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:19,428 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:19,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:19,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:19,528 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:19,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:19,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:19,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:19,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,543 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:19,543 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:19,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:19,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:19,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,546 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:19,546 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:19,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:19,546 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:19,546 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:19,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,548 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,548 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:19,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:19,548 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:19,548 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:19,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:19,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:19,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:19,550 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:19,550 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:19,550 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:19,574 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078df82ae7f8ed4dc791b44acb871e6d4b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509078df82ae7f8ed4dc791b44acb871e6d4b 2023-02-13 21:53:19,983 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/26751a3ecf7440308306dd7c92b76753 2023-02-13 21:53:19,992 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/26751a3ecf7440308306dd7c92b76753 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753 2023-02-13 21:53:20,000 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 21:53:20,001 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 451ms, sequenceid=37, compaction requested=true 2023-02-13 21:53:20,001 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:20,002 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:20,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:20,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:20,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:20,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:20,003 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,003 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:20,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:20,004 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,004 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:20,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:20,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:20,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:20,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75302cd7[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:20,005 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:20,006 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,006 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,006 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:20,006 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:20,006 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:20,006 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,007 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:20,007 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:20,007 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,007 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:20,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,007 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:20,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:20,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:20,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:20,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:20,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:20,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:20,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:20,010 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:20,010 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:20,010 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:20,010 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,010 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:20,011 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,011 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,011 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:20,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:20,012 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,013 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,014 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:20,014 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:20,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:20,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:20,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:20,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:20,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:20,015 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:20,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:20,116 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:20,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:20,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:20,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,126 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:20,126 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:20,126 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-13 21:53:20,126 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-13 21:53:20,127 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,127 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,128 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,128 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:20,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:20,128 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,128 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:20,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:20,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,130 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-13 21:53:20,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,130 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-13 21:53:20,130 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:20,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-13 21:53:20,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:20,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:20,131 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:20,131 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. started... 2023-02-13 21:53:20,131 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c5b526e37197c4eeeba0cee7de56cfa6 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:20,557 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208a2f6f339c5d4764b12fa4d5fb41ed0c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208a2f6f339c5d4764b12fa4d5fb41ed0c 2023-02-13 21:53:20,967 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/76230497134b415cb586edf1cd8346ef 2023-02-13 21:53:20,980 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/76230497134b415cb586edf1cd8346ef as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef 2023-02-13 21:53:20,989 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 21:53:20,991 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c5b526e37197c4eeeba0cee7de56cfa6 in 860ms, sequenceid=41, compaction requested=true 2023-02-13 21:53:20,991 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:20,991 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:20,991 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:20,992 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:20,992 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,992 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-13 21:53:20,992 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-13 21:53:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,994 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:20,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:20,995 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,995 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:20,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:20,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-13 21:53:20,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ceeb55a[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:20,998 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-13 21:53:20,998 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-13 21:53:21,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-13 21:53:21,002 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:21,002 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,002 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:21,003 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,003 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-13 21:53:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:21,003 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:21,003 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-13 21:53:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:21,008 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-13 21:53:21,008 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-13 21:53:21,008 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:21,008 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:21,008 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,008 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:21,018 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,018 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:21,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,018 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:21,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,019 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,022 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:21,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:21,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-13 21:53:21,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-13 21:53:21,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:21,024 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:21,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:21,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,025 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:21,025 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:21,125 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:21,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:21,136 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 21:53:21,139 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33260, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 21:53:21,140 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:21,152 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:21,153 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:21,154 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325801154 2023-02-13 21:53:21,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:21,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:53:21,162 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 21:53:21,162 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:21,162 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x4ac00500 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:21,198 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2380f810, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:21,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,092 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ad15def6084c4ef7970e708d81fe2c9e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad15def6084c4ef7970e708d81fe2c9e 2023-02-13 21:53:22,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:22,114 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:22,116 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48754, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:22,127 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:22,130 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33276, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:22,164 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/170bc6ee831442cfb6fdf6951cf76316 first=Optional[r3] last=Optional[r6] 2023-02-13 21:53:22,177 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/170bc6ee831442cfb6fdf6951cf76316}] 2023-02-13 21:53:22,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/170bc6ee831442cfb6fdf6951cf76316 for inclusion in c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:22,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 21:53:22,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:22,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:22,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/170bc6ee831442cfb6fdf6951cf76316 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1q22ib75phrp6ovunr4rjtmfiaucbdg1gcnbfr3cf57jjrrclcjoouggnt6do4cj/family1/170bc6ee831442cfb6fdf6951cf76316 2023-02-13 21:53:22,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1q22ib75phrp6ovunr4rjtmfiaucbdg1gcnbfr3cf57jjrrclcjoouggnt6do4cj/family1/170bc6ee831442cfb6fdf6951cf76316 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_ 2023-02-13 21:53:22,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1q22ib75phrp6ovunr4rjtmfiaucbdg1gcnbfr3cf57jjrrclcjoouggnt6do4cj/family1/170bc6ee831442cfb6fdf6951cf76316 into c5b526e37197c4eeeba0cee7de56cfa6/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_ - updating store file list. 2023-02-13 21:53:22,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_ into c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:22,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1q22ib75phrp6ovunr4rjtmfiaucbdg1gcnbfr3cf57jjrrclcjoouggnt6do4cj/family1/170bc6ee831442cfb6fdf6951cf76316 into c5b526e37197c4eeeba0cee7de56cfa6/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_) 2023-02-13 21:53:22,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1q22ib75phrp6ovunr4rjtmfiaucbdg1gcnbfr3cf57jjrrclcjoouggnt6do4cj/family1/170bc6ee831442cfb6fdf6951cf76316 2023-02-13 21:53:22,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:53:22,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:53:22,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): c5b526e37197c4eeeba0cee7de56cfa6/family1 is initiating minor compaction 2023-02-13 21:53:22,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@75f49856; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:22,230 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of c5b526e37197c4eeeba0cee7de56cfa6/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:22,231 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp, totalSize=50.2 K 2023-02-13 21:53:22,232 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 4ae20363eee74dc4995b26d633a51a76, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:53:22,232 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 019a81ef1c7d4ea3956440a6cc0614cd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting ec0a4744bbb54ed8ad3b9e1a68cbac2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 42a990e11a6940398ad5ef0e13b6af34, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting e367bc12816542bdb8942ebb0d2d931b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 3b0787f172044d06a68c902a5a12ff8e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 20df83a4284b48e39e14b2e4a823642e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 26751a3ecf7440308306dd7c92b76753, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:53:22,233 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 76230497134b415cb586edf1cd8346ef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:53:22,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 60e926efc1714b57aa6ea8b994352eac_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:53:22,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:22,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:22,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283c3803fdd843479c87a7e45e9f673faa to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283c3803fdd843479c87a7e45e9f673faa 2023-02-13 21:53:22,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5363b8510664125b52a77b1a8d87cca to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231c5363b8510664125b52a77b1a8d87cca 2023-02-13 21:53:22,272 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bfbbe1e4c12a4bda90162812407067a2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101bfbbe1e4c12a4bda90162812407067a2 2023-02-13 21:53:22,275 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b4202129932e4272bbf5fd26e533a3bf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b4202129932e4272bbf5fd26e533a3bf 2023-02-13 21:53:22,275 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-13 21:53:22,275 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,277 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:22,333 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): c5b526e37197c4eeeba0cee7de56cfa6#family1#compaction#10 average throughput is 0.16 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:22,762 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/d4cc9c0a46d6484e9485c3971b4ef15d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/d4cc9c0a46d6484e9485c3971b4ef15d 2023-02-13 21:53:22,778 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c5b526e37197c4eeeba0cee7de56cfa6/family1 of c5b526e37197c4eeeba0cee7de56cfa6 into d4cc9c0a46d6484e9485c3971b4ef15d(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:22,778 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:22,779 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676325202228; duration=0sec 2023-02-13 21:53:22,780 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:22,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_] to archive 2023-02-13 21:53:22,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:22,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/4ae20363eee74dc4995b26d633a51a76 2023-02-13 21:53:22,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/019a81ef1c7d4ea3956440a6cc0614cd 2023-02-13 21:53:22,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ec0a4744bbb54ed8ad3b9e1a68cbac2e 2023-02-13 21:53:22,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/42a990e11a6940398ad5ef0e13b6af34 2023-02-13 21:53:22,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/e367bc12816542bdb8942ebb0d2d931b 2023-02-13 21:53:22,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3b0787f172044d06a68c902a5a12ff8e 2023-02-13 21:53:22,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/20df83a4284b48e39e14b2e4a823642e 2023-02-13 21:53:22,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/26751a3ecf7440308306dd7c92b76753 2023-02-13 21:53:22,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/76230497134b415cb586edf1cd8346ef 2023-02-13 21:53:22,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/60e926efc1714b57aa6ea8b994352eac_SeqId_44_ 2023-02-13 21:53:23,199 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120598bc7736f9c648c9b9ca18382c220b08 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120598bc7736f9c648c9b9ca18382c220b08 2023-02-13 21:53:23,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:23,228 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8cfd3b1044664541bbf15de5d0fabba9 first=Optional[r00] last=Optional[r2] 2023-02-13 21:53:23,229 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8cfd3b1044664541bbf15de5d0fabba9}] 2023-02-13 21:53:23,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8cfd3b1044664541bbf15de5d0fabba9 for inclusion in c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:23,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 21:53:23,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:23,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:23,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8cfd3b1044664541bbf15de5d0fabba9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1ta63u4q5p664qagmnrufkf780nk6ergul7q685l0doarup6ns99vr4fsfai6lop/family1/8cfd3b1044664541bbf15de5d0fabba9 2023-02-13 21:53:23,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1ta63u4q5p664qagmnrufkf780nk6ergul7q685l0doarup6ns99vr4fsfai6lop/family1/8cfd3b1044664541bbf15de5d0fabba9 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_ 2023-02-13 21:53:23,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1ta63u4q5p664qagmnrufkf780nk6ergul7q685l0doarup6ns99vr4fsfai6lop/family1/8cfd3b1044664541bbf15de5d0fabba9 into c5b526e37197c4eeeba0cee7de56cfa6/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_ - updating store file list. 2023-02-13 21:53:23,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_ into c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:23,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1ta63u4q5p664qagmnrufkf780nk6ergul7q685l0doarup6ns99vr4fsfai6lop/family1/8cfd3b1044664541bbf15de5d0fabba9 into c5b526e37197c4eeeba0cee7de56cfa6/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_) 2023-02-13 21:53:23,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1ta63u4q5p664qagmnrufkf780nk6ergul7q685l0doarup6ns99vr4fsfai6lop/family1/8cfd3b1044664541bbf15de5d0fabba9 2023-02-13 21:53:23,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:53:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:53:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): c5b526e37197c4eeeba0cee7de56cfa6/family1 is initiating minor compaction (all files) 2023-02-13 21:53:23,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4375bfda; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:23,251 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2258): Starting compaction of c5b526e37197c4eeeba0cee7de56cfa6/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:23,253 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/d4cc9c0a46d6484e9485c3971b4ef15d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp, totalSize=358.6 K 2023-02-13 21:53:23,254 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting dd45cc16479644c7acc05d60d7357f3a, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:53:23,254 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting d4cc9c0a46d6484e9485c3971b4ef15d, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:53:23,255 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting ee1d039651494e60902693d0f0b15f0e_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809985 2023-02-13 21:53:23,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:23,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:23,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e9ac8f75cbd44e5dafbe0cb6ddd74586 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e9ac8f75cbd44e5dafbe0cb6ddd74586 2023-02-13 21:53:23,261 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201337a9ce7dcaf44d381af97cc988d0a9b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201337a9ce7dcaf44d381af97cc988d0a9b 2023-02-13 21:53:23,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120523ae5468ff164e0b8f2f273fb306fe00 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120523ae5468ff164e0b8f2f273fb306fe00 2023-02-13 21:53:23,264 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-13 21:53:23,264 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 21:53:23,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:23,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:23,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:23,266 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:23,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.1210 sec 2023-02-13 21:53:23,301 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] throttle.PressureAwareThroughputController(145): c5b526e37197c4eeeba0cee7de56cfa6#family1#compaction#11 average throughput is 5.70 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:23,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 21:53:23,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:23,890 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 21:53:23,893 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:23,893 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-13 21:53:23,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-13 21:53:23,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, REOPEN/MOVE}] 2023-02-13 21:53:23,914 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, REOPEN/MOVE 2023-02-13 21:53:23,915 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:23,916 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325203915"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325203915"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325203915"}]},"ts":"1676325203915"} 2023-02-13 21:53:23,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:24,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing c5b526e37197c4eeeba0cee7de56cfa6, disabling compactions & flushes 2023-02-13 21:53:24,076 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,143 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/.tmp/family1/1237fc790d3c4ddeaf987b13373a1c69 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/1237fc790d3c4ddeaf987b13373a1c69 2023-02-13 21:53:24,150 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c5b526e37197c4eeeba0cee7de56cfa6/family1 of c5b526e37197c4eeeba0cee7de56cfa6 into 1237fc790d3c4ddeaf987b13373a1c69(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:24,150 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:24,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. after waiting 0 ms 2023-02-13 21:53:24,150 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1676325203251; duration=0sec 2023-02-13 21:53:24,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,150 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:24,153 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/d4cc9c0a46d6484e9485c3971b4ef15d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_] to archive 2023-02-13 21:53:24,154 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:24,157 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/dd45cc16479644c7acc05d60d7357f3a 2023-02-13 21:53:24,158 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/d4cc9c0a46d6484e9485c3971b4ef15d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/d4cc9c0a46d6484e9485c3971b4ef15d 2023-02-13 21:53:24,160 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/ee1d039651494e60902693d0f0b15f0e_SeqId_47_ 2023-02-13 21:53:24,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 21:53:24,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for c5b526e37197c4eeeba0cee7de56cfa6: Waiting for close lock at 1676325204076Running coprocessor pre-close hooks at 1676325204076Disabling compacts and flushes for region at 1676325204076Disabling writes for close at 1676325204150 (+74 ms)Writing region close event to WAL at 1676325204163 (+13 ms)Running coprocessor post-close hooks at 1676325204168 (+5 ms)Closed at 1676325204169 (+1 ms) 2023-02-13 21:53:24,169 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: c5b526e37197c4eeeba0cee7de56cfa6 to self. 2023-02-13 21:53:24,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=CLOSED 2023-02-13 21:53:24,173 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325204172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325204172"}]},"ts":"1676325204172"} 2023-02-13 21:53:24,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 21:53:24,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101 in 257 msec 2023-02-13 21:53:24,178 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=true 2023-02-13 21:53:24,329 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:24,329 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325204329"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325204329"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325204329"}]},"ts":"1676325204329"} 2023-02-13 21:53:24,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:24,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c5b526e37197c4eeeba0cee7de56cfa6, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:24,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:24,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,489 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,490 DEBUG [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:24,490 DEBUG [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:24,491 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c5b526e37197c4eeeba0cee7de56cfa6 columnFamilyName family1 2023-02-13 21:53:24,498 DEBUG [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/1237fc790d3c4ddeaf987b13373a1c69 2023-02-13 21:53:24,499 INFO [StoreOpener-c5b526e37197c4eeeba0cee7de56cfa6-1] regionserver.HStore(310): Store=c5b526e37197c4eeeba0cee7de56cfa6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:24,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:53:24,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened c5b526e37197c4eeeba0cee7de56cfa6; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62342403, jitterRate=-0.0710258036851883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:24,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for c5b526e37197c4eeeba0cee7de56cfa6: Running coprocessor pre-open hook at 1676325204488Writing region info on filesystem at 1676325204488Initializing all the Stores at 1676325204489 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676325204489Cleaning up temporary data from old regions at 1676325204502 (+13 ms)Cleaning up detritus from prior splits at 1676325204502Running coprocessor post-open hooks at 1676325204505 (+3 ms)Region opened successfully at 1676325204505 2023-02-13 21:53:24,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., pid=17, masterSystemTime=1676325204484 2023-02-13 21:53:24,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:53:24,508 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c5b526e37197c4eeeba0cee7de56cfa6, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:24,508 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676325204508"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325204508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325204508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325204508"}]},"ts":"1676325204508"} 2023-02-13 21:53:24,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-13 21:53:24,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure c5b526e37197c4eeeba0cee7de56cfa6, server=jenkins-hbase20.apache.org,34815,1676325186101 in 178 msec 2023-02-13 21:53:24,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-13 21:53:24,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c5b526e37197c4eeeba0cee7de56cfa6, REOPEN/MOVE in 599 msec 2023-02-13 21:53:24,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-13 21:53:24,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 617 msec 2023-02-13 21:53:24,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0800 sec 2023-02-13 21:53:24,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-13 21:53:24,532 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(278): alter status finished 2023-02-13 21:53:24,533 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-13 21:53:24,534 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:24,535 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:24,536 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325804536 2023-02-13 21:53:24,536 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:24,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:53:24,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-13 21:53:24,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:24,539 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x7b43a636 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:24,579 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62067fed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:24,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:24,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:24,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:24,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:24,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:25,423 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287fc1b0bd34ee4cedaa18c32853509a99 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287fc1b0bd34ee4cedaa18c32853509a99 2023-02-13 21:53:25,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:25,435 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:25,436 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56522, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:25,443 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:25,445 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:25,456 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/787074d8c72d4352aba0a55e50d27675 first=Optional[r05] last=Optional[r8] 2023-02-13 21:53:25,456 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/787074d8c72d4352aba0a55e50d27675}] 2023-02-13 21:53:25,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/787074d8c72d4352aba0a55e50d27675 for inclusion in c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:25,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 21:53:25,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for c5b526e37197c4eeeba0cee7de56cfa6: 2023-02-13 21:53:25,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/787074d8c72d4352aba0a55e50d27675 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v3hl9hpkmh2ruo0ubblnhoqejkqqvh0dj24d3ohbsu4hvoudq3rdnpvhkuvtcrk3/family1/787074d8c72d4352aba0a55e50d27675 2023-02-13 21:53:25,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v3hl9hpkmh2ruo0ubblnhoqejkqqvh0dj24d3ohbsu4hvoudq3rdnpvhkuvtcrk3/family1/787074d8c72d4352aba0a55e50d27675 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3c917f6573a64cf78ee5f0f4d40b8e24_SeqId_53_ 2023-02-13 21:53:25,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v3hl9hpkmh2ruo0ubblnhoqejkqqvh0dj24d3ohbsu4hvoudq3rdnpvhkuvtcrk3/family1/787074d8c72d4352aba0a55e50d27675 into c5b526e37197c4eeeba0cee7de56cfa6/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3c917f6573a64cf78ee5f0f4d40b8e24_SeqId_53_ - updating store file list. 2023-02-13 21:53:25,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3c917f6573a64cf78ee5f0f4d40b8e24_SeqId_53_ into c5b526e37197c4eeeba0cee7de56cfa6/family1 2023-02-13 21:53:25,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v3hl9hpkmh2ruo0ubblnhoqejkqqvh0dj24d3ohbsu4hvoudq3rdnpvhkuvtcrk3/family1/787074d8c72d4352aba0a55e50d27675 into c5b526e37197c4eeeba0cee7de56cfa6/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/family1/3c917f6573a64cf78ee5f0f4d40b8e24_SeqId_53_) 2023-02-13 21:53:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__v3hl9hpkmh2ruo0ubblnhoqejkqqvh0dj24d3ohbsu4hvoudq3rdnpvhkuvtcrk3/family1/787074d8c72d4352aba0a55e50d27675 2023-02-13 21:53:25,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:25,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:25,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208a2f6f339c5d4764b12fa4d5fb41ed0c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511208a2f6f339c5d4764b12fa4d5fb41ed0c 2023-02-13 21:53:25,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285e9f499c6b154ad1ae4d79e5235adbd9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285e9f499c6b154ad1ae4d79e5235adbd9 2023-02-13 21:53:25,483 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-13 21:53:25,483 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 21:53:25,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:25,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:25,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-13 21:53:25,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-13 21:53:25,484 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:25,484 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-13 21:53:25,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 951 msec 2023-02-13 21:53:25,580 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=249 (was 210) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59330 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x7b43a636 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1956117410.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59276 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x4ac00500-SendThread(127.0.0.1:60489) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: (jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59374 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59404 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x4ac00500 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1956117410.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59380 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x7b43a636-SendThread(127.0.0.1:60489) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x16facc2-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59462 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59278 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39483b0-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59292 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59258 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16facc2-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x7b43a636-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59204 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39483b0-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:34815-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x4ac00500-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59446 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59226 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59356 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1582049654_15 at /127.0.0.1:59270 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16facc2-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59306 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:59408 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 315), ProcessCount=165 (was 165), AvailableMemoryMB=6943 (was 7460) 2023-02-13 21:53:25,592 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=165, AvailableMemoryMB=6943 2023-02-13 21:53:25,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 21:53:25,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:25,597 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:25,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-13 21:53:25,599 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:25,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:25,600 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17 2023-02-13 21:53:25,601 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17 empty. 2023-02-13 21:53:25,601 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17 2023-02-13 21:53:25,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-13 21:53:25,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:25,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:26,015 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:26,017 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 689b141ebadbd35517e42061662afb17, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:26,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 689b141ebadbd35517e42061662afb17, disabling compactions & flushes 2023-02-13 21:53:26,428 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. after waiting 0 ms 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,428 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,428 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 689b141ebadbd35517e42061662afb17: Waiting for close lock at 1676325206428Disabling compacts and flushes for region at 1676325206428Disabling writes for close at 1676325206428Writing region close event to WAL at 1676325206428Closed at 1676325206428 2023-02-13 21:53:26,431 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:26,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325206432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325206432"}]},"ts":"1676325206432"} 2023-02-13 21:53:26,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:53:26,435 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:26,435 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325206435"}]},"ts":"1676325206435"} 2023-02-13 21:53:26,436 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 21:53:26,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=689b141ebadbd35517e42061662afb17, ASSIGN}] 2023-02-13 21:53:26,440 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=689b141ebadbd35517e42061662afb17, ASSIGN 2023-02-13 21:53:26,441 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=689b141ebadbd35517e42061662afb17, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:26,593 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=689b141ebadbd35517e42061662afb17, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:26,593 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325206592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325206592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325206592"}]},"ts":"1676325206592"} 2023-02-13 21:53:26,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 689b141ebadbd35517e42061662afb17, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:26,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:26,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 689b141ebadbd35517e42061662afb17, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:26,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:26,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,760 INFO [StoreOpener-689b141ebadbd35517e42061662afb17-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,764 DEBUG [StoreOpener-689b141ebadbd35517e42061662afb17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:26,764 DEBUG [StoreOpener-689b141ebadbd35517e42061662afb17-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:26,765 INFO [StoreOpener-689b141ebadbd35517e42061662afb17-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 689b141ebadbd35517e42061662afb17 columnFamilyName family1 2023-02-13 21:53:26,768 INFO [StoreOpener-689b141ebadbd35517e42061662afb17-1] regionserver.HStore(310): Store=689b141ebadbd35517e42061662afb17/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:26,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 689b141ebadbd35517e42061662afb17 2023-02-13 21:53:26,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:26,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 689b141ebadbd35517e42061662afb17; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61955538, jitterRate=-0.07679054141044617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:26,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 689b141ebadbd35517e42061662afb17: Running coprocessor pre-open hook at 1676325206757Writing region info on filesystem at 1676325206757Initializing all the Stores at 1676325206759 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676325206760 (+1 ms)Cleaning up temporary data from old regions at 1676325206771 (+11 ms)Cleaning up detritus from prior splits at 1676325206772 (+1 ms)Running coprocessor post-open hooks at 1676325206778 (+6 ms)Region opened successfully at 1676325206778 2023-02-13 21:53:26,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., pid=21, masterSystemTime=1676325206749 2023-02-13 21:53:26,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:26,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=689b141ebadbd35517e42061662afb17, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:26,782 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325206781"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325206781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325206781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325206781"}]},"ts":"1676325206781"} 2023-02-13 21:53:26,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-13 21:53:26,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 689b141ebadbd35517e42061662afb17, server=jenkins-hbase20.apache.org,34815,1676325186101 in 187 msec 2023-02-13 21:53:26,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-13 21:53:26,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=689b141ebadbd35517e42061662afb17, ASSIGN in 348 msec 2023-02-13 21:53:26,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:26,790 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325206790"}]},"ts":"1676325206790"} 2023-02-13 21:53:26,791 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 21:53:26,794 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:26,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1990 sec 2023-02-13 21:53:27,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-13 21:53:27,709 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-13 21:53:27,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:27,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,753 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:27,754 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:27,754 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:27,754 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:27,755 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,755 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,755 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:27,755 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:27,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:27,756 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,756 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:27,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:27,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:27,757 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:27,757 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:27,757 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:27,758 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:27,758 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:27,758 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:27,758 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:27,758 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:53:28,187 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113075ecc552205346b0a910e556cf9e06db to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113075ecc552205346b0a910e556cf9e06db 2023-02-13 21:53:28,192 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/e0f76cc5ba204aecbcab460650ccfee6 2023-02-13 21:53:28,199 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/e0f76cc5ba204aecbcab460650ccfee6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6 2023-02-13 21:53:28,207 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 21:53:28,215 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 457ms, sequenceid=5, compaction requested=false 2023-02-13 21:53:28,215 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:28,216 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:28,216 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:28,217 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,217 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:28,218 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,218 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:28,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:28,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6e25e0[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:28,219 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:28,220 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,220 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,220 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:28,221 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,221 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:28,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:28,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:28,221 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:28,222 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:28,222 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:28,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:28,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:28,234 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:28,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:28,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:28,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,234 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:28,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:28,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:28,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:28,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:28,236 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,238 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:28,247 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:28,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:28,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:28,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:28,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:28,249 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:28,248 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:28,349 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:28,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:28,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:28,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:28,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,361 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:28,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:28,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:28,361 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:28,362 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,362 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,362 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,362 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:28,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:28,363 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:28,363 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,368 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:28,368 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:28,368 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:28,368 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:28,369 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:28,370 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:28,370 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:28,370 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:28,370 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:28,370 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:53:28,797 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288966b8d1bab94ba2b3468dce1112c07e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288966b8d1bab94ba2b3468dce1112c07e 2023-02-13 21:53:29,206 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/c5abcceabfaf4052863d20b37f098b2a 2023-02-13 21:53:29,212 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/c5abcceabfaf4052863d20b37f098b2a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a 2023-02-13 21:53:29,218 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:53:29,219 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 849ms, sequenceid=9, compaction requested=false 2023-02-13 21:53:29,219 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:29,219 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:29,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:29,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:29,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:29,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:29,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,221 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:29,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,221 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:29,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:29,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:29,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1343faa2[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:29,222 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:29,222 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,223 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,223 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:29,223 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:29,223 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:29,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:29,224 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:29,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:29,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:29,224 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:29,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:29,227 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:29,227 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:29,227 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:29,227 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,227 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:29,228 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,228 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,228 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:29,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:29,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:29,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:29,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,229 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:29,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:29,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:29,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:29,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:29,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:29,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:29,235 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:29,235 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:29,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:29,335 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:29,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:29,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:29,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:29,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,345 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:29,345 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:29,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:29,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:29,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,346 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,347 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,347 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:29,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:29,348 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:29,348 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:29,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:29,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,349 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,350 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:29,350 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:29,350 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:29,350 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:29,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:29,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:29,351 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:29,351 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:29,351 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:29,351 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:29,702 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:53:29,769 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cb6d5dc30c0f47c494b6b8c556279d6f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb6d5dc30c0f47c494b6b8c556279d6f 2023-02-13 21:53:30,175 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/5157a248cb3248f9afd587b134cf2e4c 2023-02-13 21:53:30,183 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/5157a248cb3248f9afd587b134cf2e4c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c 2023-02-13 21:53:30,189 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 21:53:30,190 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 839ms, sequenceid=13, compaction requested=true 2023-02-13 21:53:30,190 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:30,190 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:30,190 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:30,190 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:30,190 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,190 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:30,190 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:30,191 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,191 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,191 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,191 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:30,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:30,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67612a89[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:30,193 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:30,193 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,193 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,193 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:30,193 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:30,193 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:30,194 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,194 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:30,194 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:30,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:30,195 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:30,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:30,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:30,197 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:30,197 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:30,197 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:30,197 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,197 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:30,199 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,199 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,199 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:30,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,201 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,204 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:30,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:30,205 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:30,206 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:30,206 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:30,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:30,206 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:30,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:30,207 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:30,207 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:30,307 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:30,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:30,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:30,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:30,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,316 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:30,316 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:30,316 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:30,316 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:30,317 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,317 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,318 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:30,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:30,318 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:30,318 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,318 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:30,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,319 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,323 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,324 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:30,324 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:30,324 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:30,324 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:30,324 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:30,324 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:30,325 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:30,325 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:30,343 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ff40d4eaf69e4181a57d7d32a015eccb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ff40d4eaf69e4181a57d7d32a015eccb 2023-02-13 21:53:30,751 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/d5584343ef9d4f2e95025a68e573c678 2023-02-13 21:53:30,758 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/d5584343ef9d4f2e95025a68e573c678 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678 2023-02-13 21:53:30,764 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 21:53:30,765 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 440ms, sequenceid=17, compaction requested=true 2023-02-13 21:53:30,765 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:30,765 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:30,765 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:30,765 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:30,765 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,765 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:30,765 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:30,766 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,766 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,767 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,767 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:30,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e0c175a[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:30,768 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:30,768 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,768 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,769 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:30,769 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:30,769 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:30,769 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,769 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:30,770 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:30,770 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,770 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,770 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:30,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:30,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:30,772 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:30,772 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:30,772 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:30,772 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,772 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:30,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:30,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:30,774 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:30,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,775 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:30,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:30,776 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:30,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:30,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:30,776 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:30,777 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:30,777 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,777 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:30,777 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:30,877 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:30,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:30,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:30,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:30,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,886 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:30,886 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:30,887 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:30,887 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:30,887 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,887 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,888 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,888 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:30,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:30,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,889 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:30,889 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:30,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:30,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:30,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:30,903 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:30,903 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:30,903 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:30,907 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:30,907 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:30,907 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:30,907 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:30,907 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:31,322 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228e54979242f844062bdc8c5eb6a0b4c8c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e54979242f844062bdc8c5eb6a0b4c8c 2023-02-13 21:53:31,729 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/f1498504364f41cb9d5ee30de539f915 2023-02-13 21:53:31,736 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/f1498504364f41cb9d5ee30de539f915 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915 2023-02-13 21:53:31,743 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 21:53:31,744 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 837ms, sequenceid=21, compaction requested=true 2023-02-13 21:53:31,744 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:31,744 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:31,744 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:31,744 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:31,744 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,744 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:31,744 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:31,745 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,745 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:31,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:31,745 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,746 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:31,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21226a5e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:31,747 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:31,747 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,748 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,748 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:31,748 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,748 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:31,748 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:31,748 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:31,749 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:31,749 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,749 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:31,749 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:31,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:31,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:31,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:31,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:31,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:31,753 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:31,753 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:31,753 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:31,753 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,753 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:31,758 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,758 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,758 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:31,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:31,759 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:31,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:31,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:31,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:31,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:31,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:31,767 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:31,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,768 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,768 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:31,768 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,768 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:31,768 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,769 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:31,869 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:31,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:31,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:31,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,876 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:31,876 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:31,877 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:31,877 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:31,877 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,877 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,878 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,878 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:31,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:31,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,879 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:31,879 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:31,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:31,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,880 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:31,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:31,880 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:31,881 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:31,882 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:31,882 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:32,303 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e8fd9fc0fdec4131a9f36a1a4e933577 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e8fd9fc0fdec4131a9f36a1a4e933577 2023-02-13 21:53:32,709 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/e84dccdc78d14874a8ed5fd4741dcde1 2023-02-13 21:53:32,719 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/e84dccdc78d14874a8ed5fd4741dcde1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1 2023-02-13 21:53:32,725 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 21:53:32,726 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 844ms, sequenceid=25, compaction requested=true 2023-02-13 21:53:32,726 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:32,726 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:32,726 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:32,727 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:32,727 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,727 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:32,727 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:32,728 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,728 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:32,728 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,728 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d380232[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:32,729 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:32,729 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,730 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:32,730 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:32,730 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,730 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:32,731 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:32,731 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,731 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,731 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:32,734 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:32,734 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:32,734 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:32,734 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,734 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:32,735 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,735 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:32,735 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:32,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:32,736 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:32,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:32,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:32,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:32,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:32,740 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:32,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,740 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:32,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:32,740 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:32,740 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,741 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,741 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:32,841 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:32,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:32,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:32,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:32,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,848 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:32,848 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:32,848 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:32,848 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:32,849 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,849 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,850 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,850 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:32,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:32,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:32,850 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:32,850 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:32,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:32,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,851 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:32,851 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:32,851 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:32,851 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:32,851 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:32,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:32,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:32,852 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:32,852 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:32,852 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:33,267 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a933de1f140e494b94d07c34a23d5243 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a933de1f140e494b94d07c34a23d5243 2023-02-13 21:53:33,674 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/5bdfb97982b84e7a978bfa4baad991e0 2023-02-13 21:53:33,683 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/5bdfb97982b84e7a978bfa4baad991e0 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0 2023-02-13 21:53:33,690 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 21:53:33,691 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 839ms, sequenceid=29, compaction requested=true 2023-02-13 21:53:33,692 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:33,692 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:33,692 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:33,692 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:33,692 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,692 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:33,692 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:33,693 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,693 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:33,693 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,693 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:33,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:33,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e3507e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:33,694 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:33,695 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,695 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,695 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:33,695 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:33,695 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,695 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:33,695 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:33,696 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:33,696 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,696 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:33,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:33,696 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:33,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:33,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:33,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:33,699 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:33,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:33,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:33,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,700 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:33,701 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,701 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,701 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:33,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:33,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:33,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,704 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,706 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,706 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,706 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:33,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:33,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:33,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:33,706 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:33,706 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:33,706 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:33,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:33,707 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,707 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:33,708 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,708 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:33,708 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,708 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,808 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:33,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:33,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:33,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:33,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,825 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:33,825 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:33,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:33,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:33,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,827 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:33,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:33,828 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:33,828 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:33,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,829 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,829 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:33,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:33,830 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:33,830 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:33,831 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:33,831 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:33,831 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:33,831 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:33,831 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:33,831 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:34,256 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b236603fad3e472f8d1d74b5a04f5f77 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b236603fad3e472f8d1d74b5a04f5f77 2023-02-13 21:53:34,263 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/78a902e4497b44e9ad6e4d7c5d93451e 2023-02-13 21:53:34,269 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/78a902e4497b44e9ad6e4d7c5d93451e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e 2023-02-13 21:53:34,275 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 21:53:34,276 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 445ms, sequenceid=33, compaction requested=true 2023-02-13 21:53:34,276 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:34,276 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:34,277 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,277 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:34,277 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,277 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:34,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:34,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dfb399f[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:34,279 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:34,279 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,281 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,281 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,281 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:34,281 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:34,281 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:34,281 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:34,282 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:34,282 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:34,282 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,282 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:34,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:34,285 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:34,285 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:34,286 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:34,286 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,286 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:34,289 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,289 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,289 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:34,289 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,290 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:34,292 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:34,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:34,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:34,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:34,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:34,292 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:34,293 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,293 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,293 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,293 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:34,293 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:34,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:34,393 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:34,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:34,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:34,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:34,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,402 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:34,402 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:34,402 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:34,402 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:34,403 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,403 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,404 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:34,404 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:34,404 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:34,404 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:34,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,405 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,405 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:34,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:34,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:34,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:34,406 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:34,406 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:34,406 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:34,406 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:34,406 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:34,406 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:34,827 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090740b2f5d90fd645f4a52e33f73b0dc928 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090740b2f5d90fd645f4a52e33f73b0dc928 2023-02-13 21:53:35,233 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/8bc36a75d0364df2bc14929d332b9cf6 2023-02-13 21:53:35,239 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/8bc36a75d0364df2bc14929d332b9cf6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6 2023-02-13 21:53:35,244 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 21:53:35,245 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 839ms, sequenceid=37, compaction requested=true 2023-02-13 21:53:35,245 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:35,245 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:35,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:35,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:35,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,246 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:35,246 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:35,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:35,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:35,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:35,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:35,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f39dee4[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:35,248 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:35,248 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,249 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:35,250 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,250 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:35,251 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:35,251 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,251 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:35,251 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:35,253 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:35,253 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:35,253 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:35,253 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,254 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:35,255 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:35,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:35,255 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,256 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,257 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,257 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:35,257 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:35,257 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:35,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:35,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:35,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:35,257 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:35,257 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:35,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:35,258 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:35,359 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:35,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:35,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,366 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:35,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:35,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:53:35,366 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:35,367 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,367 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,368 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:35,368 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:35,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:35,368 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:35,369 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:35,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,370 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:53:35,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:53:35,370 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:35,371 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:53:35,371 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:35,371 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:35,371 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:35,371 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. started... 2023-02-13 21:53:35,371 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 689b141ebadbd35517e42061662afb17 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:35,791 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d1bdf6c456024c6b9d0c8e9c9e6c6800 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1bdf6c456024c6b9d0c8e9c9e6c6800 2023-02-13 21:53:36,200 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/964eb1a4fa1142d68bcda40864891df1 2023-02-13 21:53:36,207 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/964eb1a4fa1142d68bcda40864891df1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1 2023-02-13 21:53:36,213 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 21:53:36,214 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 689b141ebadbd35517e42061662afb17 in 842ms, sequenceid=41, compaction requested=true 2023-02-13 21:53:36,214 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:36,214 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:36,214 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:36,214 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:36,214 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,214 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:53:36,214 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:53:36,215 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:36,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:36,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,216 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:36,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:53:36,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32fd7ea3[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:36,217 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:36,217 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,218 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,218 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:36,218 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:53:36,218 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,218 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:36,218 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:36,219 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:53:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:36,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:36,219 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:53:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:36,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:36,222 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:53:36,222 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:36,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:36,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,223 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:36,225 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,225 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,225 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:36,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:36,226 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,233 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:36,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:36,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:53:36,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-13 21:53:36,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:36,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:36,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:36,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:36,236 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,336 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:36,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:36,338 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-13 21:53:36,340 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:36,341 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:36,342 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:36,342 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325816342 2023-02-13 21:53:36,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:53:36,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 21:53:36,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:36,345 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x523c7d86 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:36,353 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@314993b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:36,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:37,189 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037e3e28e2d3564883b707f839049f4dda to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601037e3e28e2d3564883b707f839049f4dda 2023-02-13 21:53:37,191 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:37,203 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:37,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:37,210 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:37,211 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45314, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:37,222 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93c9ed15ae8f4d92a37b6abe92a47937 first=Optional[r5] last=Optional[r6] 2023-02-13 21:53:37,223 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93c9ed15ae8f4d92a37b6abe92a47937}] 2023-02-13 21:53:37,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93c9ed15ae8f4d92a37b6abe92a47937 for inclusion in 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:37,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 21:53:37,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:37,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/93c9ed15ae8f4d92a37b6abe92a47937 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dajdf5dr2j7jc3tpvk89e41meu1lh5nuhi3un66u5rfbg5ad9in1o9hlbmameoi1/family1/93c9ed15ae8f4d92a37b6abe92a47937 2023-02-13 21:53:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dajdf5dr2j7jc3tpvk89e41meu1lh5nuhi3un66u5rfbg5ad9in1o9hlbmameoi1/family1/93c9ed15ae8f4d92a37b6abe92a47937 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_ 2023-02-13 21:53:37,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dajdf5dr2j7jc3tpvk89e41meu1lh5nuhi3un66u5rfbg5ad9in1o9hlbmameoi1/family1/93c9ed15ae8f4d92a37b6abe92a47937 into 689b141ebadbd35517e42061662afb17/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_ - updating store file list. 2023-02-13 21:53:37,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_ into 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:37,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dajdf5dr2j7jc3tpvk89e41meu1lh5nuhi3un66u5rfbg5ad9in1o9hlbmameoi1/family1/93c9ed15ae8f4d92a37b6abe92a47937 into 689b141ebadbd35517e42061662afb17/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_) 2023-02-13 21:53:37,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__dajdf5dr2j7jc3tpvk89e41meu1lh5nuhi3un66u5rfbg5ad9in1o9hlbmameoi1/family1/93c9ed15ae8f4d92a37b6abe92a47937 2023-02-13 21:53:37,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:53:37,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:53:37,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 689b141ebadbd35517e42061662afb17/family1 is initiating minor compaction 2023-02-13 21:53:37,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@493b943d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:37,252 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 689b141ebadbd35517e42061662afb17/family1 in testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:37,252 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp, totalSize=49.7 K 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting c5abcceabfaf4052863d20b37f098b2a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5157a248cb3248f9afd587b134cf2e4c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d5584343ef9d4f2e95025a68e573c678, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting f1498504364f41cb9d5ee30de539f915, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting e84dccdc78d14874a8ed5fd4741dcde1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:53:37,252 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5bdfb97982b84e7a978bfa4baad991e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:53:37,253 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 78a902e4497b44e9ad6e4d7c5d93451e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:53:37,253 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 8bc36a75d0364df2bc14929d332b9cf6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:53:37,253 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 964eb1a4fa1142d68bcda40864891df1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:53:37,253 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:53:37,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:37,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:37,257 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a933de1f140e494b94d07c34a23d5243 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a933de1f140e494b94d07c34a23d5243 2023-02-13 21:53:37,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b236603fad3e472f8d1d74b5a04f5f77 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103b236603fad3e472f8d1d74b5a04f5f77 2023-02-13 21:53:37,258 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 21:53:37,258 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 21:53:37,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:37,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:37,292 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 689b141ebadbd35517e42061662afb17#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:37,711 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/dd78041d94de46ddb89a586b37bc2f09 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/dd78041d94de46ddb89a586b37bc2f09 2023-02-13 21:53:37,718 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 689b141ebadbd35517e42061662afb17/family1 of 689b141ebadbd35517e42061662afb17 into dd78041d94de46ddb89a586b37bc2f09(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:37,718 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:37,718 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676325217251; duration=0sec 2023-02-13 21:53:37,718 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:37,719 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123160a120bb8d9d4a458360d8c7e2b7c372 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123160a120bb8d9d4a458360d8c7e2b7c372 2023-02-13 21:53:37,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:37,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_] to archive 2023-02-13 21:53:37,741 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:37,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c5abcceabfaf4052863d20b37f098b2a 2023-02-13 21:53:37,744 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5157a248cb3248f9afd587b134cf2e4c 2023-02-13 21:53:37,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/d5584343ef9d4f2e95025a68e573c678 2023-02-13 21:53:37,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/f1498504364f41cb9d5ee30de539f915 2023-02-13 21:53:37,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e84dccdc78d14874a8ed5fd4741dcde1 2023-02-13 21:53:37,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5bdfb97982b84e7a978bfa4baad991e0 2023-02-13 21:53:37,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/78a902e4497b44e9ad6e4d7c5d93451e 2023-02-13 21:53:37,753 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/407a088c09e84bd4a2486d7058e86b2f first=Optional[r1] last=Optional[r4] 2023-02-13 21:53:37,754 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/407a088c09e84bd4a2486d7058e86b2f}] 2023-02-13 21:53:37,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/8bc36a75d0364df2bc14929d332b9cf6 2023-02-13 21:53:37,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/407a088c09e84bd4a2486d7058e86b2f for inclusion in 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:37,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/964eb1a4fa1142d68bcda40864891df1 2023-02-13 21:53:37,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/c70501de4ae743a7aecb3f2d11b6c51d_SeqId_44_ 2023-02-13 21:53:37,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 21:53:37,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:37,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:37,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/407a088c09e84bd4a2486d7058e86b2f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__522tnjges0pcltbikg3spmltr7j11km43f2p4bqgir3b5bv1fj67ulgflnuonu9s/family1/407a088c09e84bd4a2486d7058e86b2f 2023-02-13 21:53:37,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__522tnjges0pcltbikg3spmltr7j11km43f2p4bqgir3b5bv1fj67ulgflnuonu9s/family1/407a088c09e84bd4a2486d7058e86b2f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_ 2023-02-13 21:53:37,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__522tnjges0pcltbikg3spmltr7j11km43f2p4bqgir3b5bv1fj67ulgflnuonu9s/family1/407a088c09e84bd4a2486d7058e86b2f into 689b141ebadbd35517e42061662afb17/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_ - updating store file list. 2023-02-13 21:53:37,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_ into 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:37,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__522tnjges0pcltbikg3spmltr7j11km43f2p4bqgir3b5bv1fj67ulgflnuonu9s/family1/407a088c09e84bd4a2486d7058e86b2f into 689b141ebadbd35517e42061662afb17/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_) 2023-02-13 21:53:37,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__522tnjges0pcltbikg3spmltr7j11km43f2p4bqgir3b5bv1fj67ulgflnuonu9s/family1/407a088c09e84bd4a2486d7058e86b2f 2023-02-13 21:53:37,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:53:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:53:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 689b141ebadbd35517e42061662afb17/family1 is initiating minor compaction (all files) 2023-02-13 21:53:37,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3bbc405e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:37,772 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 689b141ebadbd35517e42061662afb17/family1 in testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:53:37,772 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/dd78041d94de46ddb89a586b37bc2f09, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp, totalSize=178.1 K 2023-02-13 21:53:37,773 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting e0f76cc5ba204aecbcab460650ccfee6, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:53:37,773 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting dd78041d94de46ddb89a586b37bc2f09, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:53:37,773 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209985 2023-02-13 21:53:37,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:37,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:37,776 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb6d5dc30c0f47c494b6b8c556279d6f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb6d5dc30c0f47c494b6b8c556279d6f 2023-02-13 21:53:37,777 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ff40d4eaf69e4181a57d7d32a015eccb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205ff40d4eaf69e4181a57d7d32a015eccb 2023-02-13 21:53:37,779 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e54979242f844062bdc8c5eb6a0b4c8c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228e54979242f844062bdc8c5eb6a0b4c8c 2023-02-13 21:53:37,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e8fd9fc0fdec4131a9f36a1a4e933577 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231e8fd9fc0fdec4131a9f36a1a4e933577 2023-02-13 21:53:37,780 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 21:53:37,780 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 21:53:37,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:37,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:37,796 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 689b141ebadbd35517e42061662afb17#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:38,652 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/.tmp/family1/2de655adce124411985a50fc14d4270d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/2de655adce124411985a50fc14d4270d 2023-02-13 21:53:38,653 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113065de31586a9141aaad91f6c2ec5e0180 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113065de31586a9141aaad91f6c2ec5e0180 2023-02-13 21:53:38,654 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:38,660 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 689b141ebadbd35517e42061662afb17/family1 of 689b141ebadbd35517e42061662afb17 into 2de655adce124411985a50fc14d4270d(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:38,661 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:38,661 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676325217772; duration=0sec 2023-02-13 21:53:38,661 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:38,682 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9c8f3c41645a4b40b2ac4675e376edba first=Optional[r00] last=Optional[r8] 2023-02-13 21:53:38,682 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9c8f3c41645a4b40b2ac4675e376edba}] 2023-02-13 21:53:38,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9c8f3c41645a4b40b2ac4675e376edba for inclusion in 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 21:53:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:38,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 689b141ebadbd35517e42061662afb17: 2023-02-13 21:53:38,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9c8f3c41645a4b40b2ac4675e376edba to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d31te2mdp22jc1g8l06olukcstfq1t62uodd1i5577hn3i6vpdofvjdsmp68snf3/family1/9c8f3c41645a4b40b2ac4675e376edba 2023-02-13 21:53:38,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d31te2mdp22jc1g8l06olukcstfq1t62uodd1i5577hn3i6vpdofvjdsmp68snf3/family1/9c8f3c41645a4b40b2ac4675e376edba as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/1ecfab2e4c23481da0dc8502f8ba5d89_SeqId_50_ 2023-02-13 21:53:38,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d31te2mdp22jc1g8l06olukcstfq1t62uodd1i5577hn3i6vpdofvjdsmp68snf3/family1/9c8f3c41645a4b40b2ac4675e376edba into 689b141ebadbd35517e42061662afb17/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/1ecfab2e4c23481da0dc8502f8ba5d89_SeqId_50_ - updating store file list. 2023-02-13 21:53:38,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/1ecfab2e4c23481da0dc8502f8ba5d89_SeqId_50_ into 689b141ebadbd35517e42061662afb17/family1 2023-02-13 21:53:38,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d31te2mdp22jc1g8l06olukcstfq1t62uodd1i5577hn3i6vpdofvjdsmp68snf3/family1/9c8f3c41645a4b40b2ac4675e376edba into 689b141ebadbd35517e42061662afb17/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/1ecfab2e4c23481da0dc8502f8ba5d89_SeqId_50_) 2023-02-13 21:53:38,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithMonthlyPolicy__d31te2mdp22jc1g8l06olukcstfq1t62uodd1i5577hn3i6vpdofvjdsmp68snf3/family1/9c8f3c41645a4b40b2ac4675e376edba 2023-02-13 21:53:38,706 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:38,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:38,709 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1bdf6c456024c6b9d0c8e9c9e6c6800 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120d1bdf6c456024c6b9d0c8e9c9e6c6800 2023-02-13 21:53:38,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288966b8d1bab94ba2b3468dce1112c07e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511288966b8d1bab94ba2b3468dce1112c07e 2023-02-13 21:53:38,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113075ecc552205346b0a910e556cf9e06db to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113075ecc552205346b0a910e556cf9e06db 2023-02-13 21:53:38,712 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 21:53:38,712 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 21:53:38,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:38,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:38,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:53:38,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:53:38,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:38,714 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:38,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.3750 sec 2023-02-13 21:53:38,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/dd78041d94de46ddb89a586b37bc2f09, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_] to archive 2023-02-13 21:53:38,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:38,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/e0f76cc5ba204aecbcab460650ccfee6 2023-02-13 21:53:38,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/dd78041d94de46ddb89a586b37bc2f09 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/dd78041d94de46ddb89a586b37bc2f09 2023-02-13 21:53:38,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/family1/5728c671dff54ddc9ce0cb4fca5e764b_SeqId_47_ 2023-02-13 21:53:38,845 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253 (was 249) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54590 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x523c7d86 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1956117410.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x523c7d86-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:60489@0x523c7d86-SendThread(127.0.0.1:60489) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54620 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54726 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54664 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54656 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54642 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1582049654_15 at /127.0.0.1:54696 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54778 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54560 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54604 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54634 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54704 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54618 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54578 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1434494448_15 at /127.0.0.1:54540 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1582049654_15 at /127.0.0.1:54598 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7fe13c27-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=607 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 268), ProcessCount=165 (was 165), AvailableMemoryMB=7389 (was 6943) - AvailableMemoryMB LEAK? - 2023-02-13 21:53:38,863 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=253, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=165, AvailableMemoryMB=7387 2023-02-13 21:53:38,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:53:38,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:38,868 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:38,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-13 21:53:38,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:38,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:38,875 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:38,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616 empty. 2023-02-13 21:53:38,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:38,876 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-13 21:53:38,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:39,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:39,291 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:39,293 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => afec7cc7c29021c5831cdc083c828616, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:39,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing afec7cc7c29021c5831cdc083c828616, disabling compactions & flushes 2023-02-13 21:53:39,702 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. after waiting 0 ms 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:39,702 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:39,702 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for afec7cc7c29021c5831cdc083c828616: Waiting for close lock at 1676325219702Disabling compacts and flushes for region at 1676325219702Disabling writes for close at 1676325219702Writing region close event to WAL at 1676325219702Closed at 1676325219702 2023-02-13 21:53:39,705 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:39,706 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325219706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325219706"}]},"ts":"1676325219706"} 2023-02-13 21:53:39,707 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:53:39,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:39,709 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325219709"}]},"ts":"1676325219709"} 2023-02-13 21:53:39,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 21:53:39,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afec7cc7c29021c5831cdc083c828616, ASSIGN}] 2023-02-13 21:53:39,716 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afec7cc7c29021c5831cdc083c828616, ASSIGN 2023-02-13 21:53:39,717 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afec7cc7c29021c5831cdc083c828616, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:39,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=afec7cc7c29021c5831cdc083c828616, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:39,869 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325219868"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325219868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325219868"}]},"ts":"1676325219868"} 2023-02-13 21:53:39,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure afec7cc7c29021c5831cdc083c828616, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:39,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:40,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => afec7cc7c29021c5831cdc083c828616, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,029 INFO [StoreOpener-afec7cc7c29021c5831cdc083c828616-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,031 DEBUG [StoreOpener-afec7cc7c29021c5831cdc083c828616-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:40,031 DEBUG [StoreOpener-afec7cc7c29021c5831cdc083c828616-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:40,031 INFO [StoreOpener-afec7cc7c29021c5831cdc083c828616-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region afec7cc7c29021c5831cdc083c828616 columnFamilyName family1 2023-02-13 21:53:40,033 INFO [StoreOpener-afec7cc7c29021c5831cdc083c828616-1] regionserver.HStore(310): Store=afec7cc7c29021c5831cdc083c828616/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:40,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for afec7cc7c29021c5831cdc083c828616 2023-02-13 21:53:40,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:40,040 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened afec7cc7c29021c5831cdc083c828616; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59689736, jitterRate=-0.11055362224578857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:40,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for afec7cc7c29021c5831cdc083c828616: Running coprocessor pre-open hook at 1676325220028Writing region info on filesystem at 1676325220028Initializing all the Stores at 1676325220029 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325220029Cleaning up temporary data from old regions at 1676325220035 (+6 ms)Cleaning up detritus from prior splits at 1676325220035Running coprocessor post-open hooks at 1676325220040 (+5 ms)Region opened successfully at 1676325220040 2023-02-13 21:53:40,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616., pid=25, masterSystemTime=1676325220024 2023-02-13 21:53:40,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:40,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:40,043 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=afec7cc7c29021c5831cdc083c828616, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:40,044 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325220043"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325220043"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325220043"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325220043"}]},"ts":"1676325220043"} 2023-02-13 21:53:40,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-13 21:53:40,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure afec7cc7c29021c5831cdc083c828616, server=jenkins-hbase20.apache.org,34815,1676325186101 in 175 msec 2023-02-13 21:53:40,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-13 21:53:40,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=afec7cc7c29021c5831cdc083c828616, ASSIGN in 334 msec 2023-02-13 21:53:40,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:40,051 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325220051"}]},"ts":"1676325220051"} 2023-02-13 21:53:40,053 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 21:53:40,054 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:40,056 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1890 sec 2023-02-13 21:53:40,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-13 21:53:40,979 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-13 21:53:41,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:41,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,013 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:41,013 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:41,013 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:41,013 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:41,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,014 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:41,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:41,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:41,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:41,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:41,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:41,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:41,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:41,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:41,016 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:41,016 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:41,017 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:53:41,042 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130add39f726f854b2e82c6c239371c78d3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130add39f726f854b2e82c6c239371c78d3 2023-02-13 21:53:41,046 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/ce41fdfbb1774ff3bed9258dabfab8bb 2023-02-13 21:53:41,053 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/ce41fdfbb1774ff3bed9258dabfab8bb as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb 2023-02-13 21:53:41,058 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 21:53:41,059 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 43ms, sequenceid=5, compaction requested=false 2023-02-13 21:53:41,059 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:41,060 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:41,060 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:41,060 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:41,060 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:41,060 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,060 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:41,060 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:41,062 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,062 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:41,062 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,062 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:41,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b44b822[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:41,063 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:41,063 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,064 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,064 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:41,064 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:41,064 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:41,064 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,064 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:41,065 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,065 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:41,065 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:41,065 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:41,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:41,067 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:41,067 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:41,067 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:41,067 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,067 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:41,068 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,068 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,068 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:41,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:41,069 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,070 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:41,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:41,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:41,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,072 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:41,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:41,072 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:41,073 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:41,073 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,173 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:41,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:41,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:41,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:41,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,180 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:41,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:41,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:41,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:41,181 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,181 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,182 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:41,182 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,182 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:41,183 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:41,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,183 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,184 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:41,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:41,193 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:41,193 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:41,193 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:41,193 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:41,193 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:53:41,614 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283d873eae17904518b667219f5e689ddc to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511283d873eae17904518b667219f5e689ddc 2023-02-13 21:53:42,019 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/5af6e1eab1fe4e6e8a9e20e62db82db4 2023-02-13 21:53:42,026 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/5af6e1eab1fe4e6e8a9e20e62db82db4 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4 2023-02-13 21:53:42,032 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:53:42,033 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 840ms, sequenceid=9, compaction requested=false 2023-02-13 21:53:42,033 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:42,033 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:42,034 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:42,034 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:42,034 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,034 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:42,034 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:42,035 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,035 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,035 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,035 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:42,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:42,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5fc75314[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:42,036 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:42,036 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,037 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:42,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:42,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:42,037 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,037 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:42,038 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,038 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:42,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:42,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:42,040 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:42,040 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:42,040 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:42,041 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,041 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:42,041 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,041 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,041 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:42,042 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,043 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,044 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:42,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:42,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:42,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:42,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:42,045 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,045 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:42,045 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,045 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:42,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:42,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:42,045 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,145 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:42,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:42,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:42,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:42,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,151 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:42,151 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:42,152 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:42,152 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:42,152 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,152 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,153 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:42,153 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:42,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:42,154 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,154 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:42,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:42,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:42,155 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:42,155 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:42,155 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:42,155 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:42,571 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120157cfa131acc646b1bfa3a1d7267e4d45 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120157cfa131acc646b1bfa3a1d7267e4d45 2023-02-13 21:53:42,978 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/44bbd5355c89487e8168a5ce1fe7c17e 2023-02-13 21:53:42,984 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/44bbd5355c89487e8168a5ce1fe7c17e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e 2023-02-13 21:53:42,989 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 21:53:42,990 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 835ms, sequenceid=13, compaction requested=true 2023-02-13 21:53:42,990 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:42,990 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:42,990 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:42,990 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:42,990 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,990 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:42,990 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:42,991 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,991 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,991 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,991 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:42,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e1868f6[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:42,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:42,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,993 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,993 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:42,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:42,993 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:42,993 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:42,994 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:42,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:42,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:42,996 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:42,996 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:42,996 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:42,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:42,996 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,996 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:42,997 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,997 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:42,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,997 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:42,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:42,998 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:42,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,999 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:42,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,001 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:43,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:43,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:43,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:43,001 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,002 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:43,002 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:43,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:43,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:43,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:43,102 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:43,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:43,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:43,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:43,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,108 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:43,108 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:43,109 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:43,109 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:43,109 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,109 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,110 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:43,110 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:43,110 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,112 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,112 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:43,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,112 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:43,112 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:43,112 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:43,112 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:43,112 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:43,112 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:43,112 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:43,112 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:43,527 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053fc861a12d23410ead97c1866554fec8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053fc861a12d23410ead97c1866554fec8 2023-02-13 21:53:43,945 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/e224292cf8554a2da488bf9d58d6525c 2023-02-13 21:53:43,951 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/e224292cf8554a2da488bf9d58d6525c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c 2023-02-13 21:53:43,957 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 21:53:43,958 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 846ms, sequenceid=17, compaction requested=true 2023-02-13 21:53:43,958 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:43,958 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:43,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:43,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:43,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:43,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:43,960 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,960 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:43,960 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,960 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:43,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:43,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17c90ff0[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:43,962 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:43,962 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,962 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,962 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:43,963 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:43,963 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,963 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:43,963 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:43,964 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:43,964 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,964 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:43,964 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:43,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:43,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:43,966 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:43,966 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:43,966 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:43,966 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,966 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:43,967 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,967 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,967 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:43,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:43,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:43,967 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,968 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:43,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:43,970 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:43,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:43,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:43,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:43,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,970 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:43,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:43,971 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:43,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:43,971 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:44,071 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:44,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:44,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:44,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:44,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,078 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:44,079 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:44,079 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:44,079 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:44,079 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,079 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,080 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,080 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:44,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:44,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:44,080 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,080 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:44,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:44,082 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:44,082 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:44,082 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:44,082 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:44,082 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:44,496 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228181e5ff83f7942ed80c19a208a72e4c0 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228181e5ff83f7942ed80c19a208a72e4c0 2023-02-13 21:53:44,903 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/93718c5e2c24416bb59f09b911e7299c 2023-02-13 21:53:44,909 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/93718c5e2c24416bb59f09b911e7299c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c 2023-02-13 21:53:44,915 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 21:53:44,916 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 834ms, sequenceid=21, compaction requested=true 2023-02-13 21:53:44,917 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:44,917 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:44,917 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:44,917 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:44,917 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,917 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:44,917 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:44,918 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,918 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:44,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:44,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59823083[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:44,920 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:44,920 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,921 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,921 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:44,921 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:44,921 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,921 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:44,921 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:44,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:44,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:44,922 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:44,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:44,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:44,924 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:44,924 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:44,924 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:44,924 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:44,924 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,924 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:44,925 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,925 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,925 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:44,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:44,926 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,927 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,928 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:44,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:44,929 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:44,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:44,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:44,929 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,029 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:45,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:45,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,051 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:45,051 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:45,051 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:45,051 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:45,052 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,052 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:45,053 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:45,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:45,054 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,054 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:45,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,054 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,057 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:45,057 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,057 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:45,057 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:45,057 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:45,059 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:45,059 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:45,059 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:45,059 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:45,059 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:45,087 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:53:45,087 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b43a636 to 127.0.0.1:60489 2023-02-13 21:53:45,087 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:53:45,089 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:53:45,090 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ac00500 to 127.0.0.1:60489 2023-02-13 21:53:45,090 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:53:45,093 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:53:45,093 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x523c7d86 to 127.0.0.1:60489 2023-02-13 21:53:45,093 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:53:45,474 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319cc962bffb79485dbd45745784974b79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319cc962bffb79485dbd45745784974b79 2023-02-13 21:53:45,591 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:53:45,880 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/0c39c9179cce43a0aef8e46dc3fcc19b 2023-02-13 21:53:45,886 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/0c39c9179cce43a0aef8e46dc3fcc19b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b 2023-02-13 21:53:45,893 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 21:53:45,894 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 835ms, sequenceid=25, compaction requested=true 2023-02-13 21:53:45,894 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:45,894 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:45,894 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:45,894 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:45,894 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,894 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:45,894 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:45,895 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,895 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:45,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:45,895 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,896 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:45,897 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3cb89754[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:45,897 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,897 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,897 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:45,897 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,898 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:45,897 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:45,898 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:45,900 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:45,900 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:45,900 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,900 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:45,902 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:45,902 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:45,902 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:45,902 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,902 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:45,903 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,903 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:45,903 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:45,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:45,904 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,905 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,906 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:45,906 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:45,906 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:45,906 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,906 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:45,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:45,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:45,906 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:45,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:45,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:45,907 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:46,007 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:46,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:46,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:46,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:46,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,014 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:46,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:46,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:46,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:46,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:46,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:46,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,015 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:46,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:46,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,016 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:46,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:46,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:46,016 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:46,017 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:46,017 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:46,017 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:46,017 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:46,017 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:46,434 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d344ae0f400348c8b0c3cc576b154f46 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d344ae0f400348c8b0c3cc576b154f46 2023-02-13 21:53:46,840 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/5254500f79b64839a7cc831bef2ab8e8 2023-02-13 21:53:46,845 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/5254500f79b64839a7cc831bef2ab8e8 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8 2023-02-13 21:53:46,850 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 21:53:46,852 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 835ms, sequenceid=29, compaction requested=true 2023-02-13 21:53:46,852 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:46,852 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:46,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:46,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:46,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:46,852 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:46,853 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,853 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:46,853 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,853 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:46,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:46,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@316a17ed[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:46,855 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:46,855 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,856 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,856 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,856 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:46,856 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:46,856 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:46,856 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:46,857 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,857 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,857 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:46,858 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:46,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:46,860 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:46,860 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:46,860 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:46,860 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,860 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:46,861 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,861 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:46,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,861 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:46,861 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,862 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:46,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:46,864 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:46,864 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:46,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:46,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,964 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:46,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:46,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:46,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:46,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,975 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:46,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:46,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:46,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:46,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,976 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:46,976 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:46,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:46,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:46,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,977 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:46,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:46,978 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:46,978 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:46,978 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:47,400 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030116099b1acf45a095add79860489705 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030116099b1acf45a095add79860489705 2023-02-13 21:53:47,807 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/8593250b2ca646fb9389624a86262206 2023-02-13 21:53:47,821 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/8593250b2ca646fb9389624a86262206 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206 2023-02-13 21:53:47,826 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 21:53:47,827 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 849ms, sequenceid=33, compaction requested=true 2023-02-13 21:53:47,827 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:47,827 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:47,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:47,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:47,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:47,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:47,828 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,828 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:47,829 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,829 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:47,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:47,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:47,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:47,831 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e0338bf[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:47,831 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:47,831 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,832 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:47,832 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:47,832 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:47,832 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,832 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:47,832 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:47,833 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,833 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:47,833 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:47,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:47,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:47,835 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:47,835 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:47,835 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:47,835 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,835 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:47,836 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,836 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:47,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,836 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:47,836 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:47,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,837 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:47,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,838 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,838 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,838 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,839 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:47,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:47,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:47,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:47,839 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:47,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:47,939 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:47,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:47,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:47,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:47,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,955 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:47,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:47,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:47,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:47,956 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,956 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,957 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,957 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:47,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:47,958 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:47,958 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,959 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,959 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:47,959 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:47,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:47,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:47,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:47,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:47,959 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:47,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:47,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:47,960 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:48,374 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090737dfa0e728f445a8b6d816be5559e5ef to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090737dfa0e728f445a8b6d816be5559e5ef 2023-02-13 21:53:48,781 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/7cce2a73047d4374a9193e59aee43df3 2023-02-13 21:53:48,791 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/7cce2a73047d4374a9193e59aee43df3 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3 2023-02-13 21:53:48,797 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 21:53:48,798 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 838ms, sequenceid=37, compaction requested=true 2023-02-13 21:53:48,798 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:48,798 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:48,798 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:48,799 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:48,799 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,799 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:48,799 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:48,801 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,801 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:48,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:48,802 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,802 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:48,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:48,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@264d1bd4[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:48,803 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:48,803 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,804 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,804 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:48,804 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:48,804 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:48,804 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,804 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:48,805 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:48,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:48,805 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:48,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:48,807 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:48,808 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:48,808 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:48,808 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,808 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:48,808 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,808 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:48,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,808 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,809 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:48,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,810 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,811 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:48,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:48,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:48,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:48,811 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:48,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:48,812 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,812 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:48,912 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:48,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:48,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:48,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,919 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:48,919 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:48,919 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:48,919 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:48,920 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,920 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,920 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:48,920 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:48,921 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:48,921 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,922 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,922 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:48,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:48,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:48,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:48,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:48,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:48,922 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:48,922 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:48,922 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. started... 2023-02-13 21:53:48,923 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing afec7cc7c29021c5831cdc083c828616 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:53:49,339 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120536354f87cf048fdaa06c95f03568b3f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120536354f87cf048fdaa06c95f03568b3f 2023-02-13 21:53:49,746 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/23e4dc5116f1455782e84fb203aab559 2023-02-13 21:53:49,754 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/23e4dc5116f1455782e84fb203aab559 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559 2023-02-13 21:53:49,760 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 21:53:49,761 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for afec7cc7c29021c5831cdc083c828616 in 838ms, sequenceid=41, compaction requested=true 2023-02-13 21:53:49,762 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:49,762 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:49,762 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:49,762 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:49,762 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,762 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:49,762 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:49,763 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,764 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:49,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:49,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5eb72a7e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:49,765 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:49,765 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,766 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,766 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:49,766 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:49,766 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:49,766 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,766 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:49,767 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:49,767 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,767 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:49,767 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:49,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:49,769 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:49,769 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:49,770 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:49,770 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,770 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:49,770 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,770 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:49,770 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:49,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:49,771 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:49,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,772 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,773 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-13 21:53:49,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:49,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:49,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:49,773 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,774 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:49,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:49,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:49,774 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,774 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,874 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:49,876 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-13 21:53:49,877 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:49,878 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:49,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:49,879 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325829879 2023-02-13 21:53:49,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:53:49,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 21:53:49,883 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:49,883 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x50feb929 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:49,888 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2688b715, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:49,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,736 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e1780e24f14a4c5f89035e0f45360652 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103e1780e24f14a4c5f89035e0f45360652 2023-02-13 21:53:50,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:50,750 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:50,751 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34784, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:50,758 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:50,760 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54086, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:50,769 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff0207158ef84b509940d847506e07fd first=Optional[r3] last=Optional[r6] 2023-02-13 21:53:50,770 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff0207158ef84b509940d847506e07fd}] 2023-02-13 21:53:50,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff0207158ef84b509940d847506e07fd for inclusion in afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:50,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 21:53:50,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:50,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:50,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/ff0207158ef84b509940d847506e07fd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cf4f7gdc7t07olptsihi64njusvj8gb6nu0gpaqlv13do502d73742q702f2296t/family1/ff0207158ef84b509940d847506e07fd 2023-02-13 21:53:50,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cf4f7gdc7t07olptsihi64njusvj8gb6nu0gpaqlv13do502d73742q702f2296t/family1/ff0207158ef84b509940d847506e07fd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_ 2023-02-13 21:53:50,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cf4f7gdc7t07olptsihi64njusvj8gb6nu0gpaqlv13do502d73742q702f2296t/family1/ff0207158ef84b509940d847506e07fd into afec7cc7c29021c5831cdc083c828616/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_ - updating store file list. 2023-02-13 21:53:50,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_ into afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:50,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cf4f7gdc7t07olptsihi64njusvj8gb6nu0gpaqlv13do502d73742q702f2296t/family1/ff0207158ef84b509940d847506e07fd into afec7cc7c29021c5831cdc083c828616/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_) 2023-02-13 21:53:50,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cf4f7gdc7t07olptsihi64njusvj8gb6nu0gpaqlv13do502d73742q702f2296t/family1/ff0207158ef84b509940d847506e07fd 2023-02-13 21:53:50,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:53:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:53:50,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): afec7cc7c29021c5831cdc083c828616/family1 is initiating minor compaction 2023-02-13 21:53:50,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e775e2f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:50,793 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of afec7cc7c29021c5831cdc083c828616/family1 in testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:50,793 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp, totalSize=50.0 K 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5af6e1eab1fe4e6e8a9e20e62db82db4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 44bbd5355c89487e8168a5ce1fe7c17e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting e224292cf8554a2da488bf9d58d6525c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 93718c5e2c24416bb59f09b911e7299c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 0c39c9179cce43a0aef8e46dc3fcc19b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5254500f79b64839a7cc831bef2ab8e8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 8593250b2ca646fb9389624a86262206, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:53:50,793 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 7cce2a73047d4374a9193e59aee43df3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:53:50,794 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 23e4dc5116f1455782e84fb203aab559, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:53:50,794 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d61f5f669d774b048c7194e5514cc332_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:53:50,795 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:50,796 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:50,797 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228181e5ff83f7942ed80c19a208a72e4c0 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228181e5ff83f7942ed80c19a208a72e4c0 2023-02-13 21:53:50,798 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319cc962bffb79485dbd45745784974b79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512319cc962bffb79485dbd45745784974b79 2023-02-13 21:53:50,799 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d344ae0f400348c8b0c3cc576b154f46 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d344ae0f400348c8b0c3cc576b154f46 2023-02-13 21:53:50,801 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030116099b1acf45a095add79860489705 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030116099b1acf45a095add79860489705 2023-02-13 21:53:50,801 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 21:53:50,801 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 21:53:50,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:50,833 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): afec7cc7c29021c5831cdc083c828616#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:51,237 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120504465632a7c44f4bab2e724a9436ae5c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120504465632a7c44f4bab2e724a9436ae5c 2023-02-13 21:53:51,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:51,264 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/9260f958bcbb4acf93ef9797ef7baf25 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/9260f958bcbb4acf93ef9797ef7baf25 2023-02-13 21:53:51,267 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/25089945e0bb4c15950372478f685f93 first=Optional[r1] last=Optional[r2] 2023-02-13 21:53:51,267 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/25089945e0bb4c15950372478f685f93}] 2023-02-13 21:53:51,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/25089945e0bb4c15950372478f685f93 for inclusion in afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:51,271 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in afec7cc7c29021c5831cdc083c828616/family1 of afec7cc7c29021c5831cdc083c828616 into 9260f958bcbb4acf93ef9797ef7baf25(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:51,271 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:51,271 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676325230792; duration=0sec 2023-02-13 21:53:51,271 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 21:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:53:51,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:51,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/25089945e0bb4c15950372478f685f93 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b5ss0molq73pgqapmhl1ildl5fri3u2omq2q0675itsmpnsr3lddh34k5kuje4go/family1/25089945e0bb4c15950372478f685f93 2023-02-13 21:53:51,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b5ss0molq73pgqapmhl1ildl5fri3u2omq2q0675itsmpnsr3lddh34k5kuje4go/family1/25089945e0bb4c15950372478f685f93 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_ 2023-02-13 21:53:51,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b5ss0molq73pgqapmhl1ildl5fri3u2omq2q0675itsmpnsr3lddh34k5kuje4go/family1/25089945e0bb4c15950372478f685f93 into afec7cc7c29021c5831cdc083c828616/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_ - updating store file list. 2023-02-13 21:53:51,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_ into afec7cc7c29021c5831cdc083c828616/family1 2023-02-13 21:53:51,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b5ss0molq73pgqapmhl1ildl5fri3u2omq2q0675itsmpnsr3lddh34k5kuje4go/family1/25089945e0bb4c15950372478f685f93 into afec7cc7c29021c5831cdc083c828616/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_) 2023-02-13 21:53:51,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithWeeklyPolicy__b5ss0molq73pgqapmhl1ildl5fri3u2omq2q0675itsmpnsr3lddh34k5kuje4go/family1/25089945e0bb4c15950372478f685f93 2023-02-13 21:53:51,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:53:51,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:53:51,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): afec7cc7c29021c5831cdc083c828616/family1 is initiating minor compaction (all files) 2023-02-13 21:53:51,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@522d1466; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:51,286 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of afec7cc7c29021c5831cdc083c828616/family1 in testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:53:51,286 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/9260f958bcbb4acf93ef9797ef7baf25, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp, totalSize=176.8 K 2023-02-13 21:53:51,287 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting ce41fdfbb1774ff3bed9258dabfab8bb, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:53:51,287 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 9260f958bcbb4acf93ef9797ef7baf25, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:53:51,288 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209985 2023-02-13 21:53:51,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:51,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:51,291 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120157cfa131acc646b1bfa3a1d7267e4d45 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120157cfa131acc646b1bfa3a1d7267e4d45 2023-02-13 21:53:51,293 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053fc861a12d23410ead97c1866554fec8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512053fc861a12d23410ead97c1866554fec8 2023-02-13 21:53:51,293 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-13 21:53:51,293 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 21:53:51,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:53:51,294 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:53:51,294 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:51,295 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:53:51,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4190 sec 2023-02-13 21:53:51,314 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): afec7cc7c29021c5831cdc083c828616#family1#compaction#35 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:51,344 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_] to archive 2023-02-13 21:53:51,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:51,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5af6e1eab1fe4e6e8a9e20e62db82db4 2023-02-13 21:53:51,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/44bbd5355c89487e8168a5ce1fe7c17e 2023-02-13 21:53:51,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/e224292cf8554a2da488bf9d58d6525c 2023-02-13 21:53:51,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/93718c5e2c24416bb59f09b911e7299c 2023-02-13 21:53:51,361 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 41 more 2023-02-13 21:53:51,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0c39c9179cce43a0aef8e46dc3fcc19b 2023-02-13 21:53:51,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/5254500f79b64839a7cc831bef2ab8e8 2023-02-13 21:53:51,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/8593250b2ca646fb9389624a86262206 2023-02-13 21:53:51,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/7cce2a73047d4374a9193e59aee43df3 2023-02-13 21:53:51,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/23e4dc5116f1455782e84fb203aab559 2023-02-13 21:53:51,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/d61f5f669d774b048c7194e5514cc332_SeqId_44_ 2023-02-13 21:53:51,451 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252 (was 253), OpenFileDescriptor=596 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=196 (was 242), ProcessCount=165 (was 165), AvailableMemoryMB=7661 (was 7387) - AvailableMemoryMB LEAK? - 2023-02-13 21:53:51,461 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=252, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=196, ProcessCount=165, AvailableMemoryMB=7656 2023-02-13 21:53:51,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 21:53:51,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:51,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:51,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-13 21:53:51,472 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:51,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:51,475 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:51,484 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845 empty. 2023-02-13 21:53:51,484 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:51,484 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:51,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:51,485 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03 empty. 2023-02-13 21:53:51,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29 empty. 2023-02-13 21:53:51,486 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:51,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:51,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-13 21:53:51,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:51,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:51,791 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/.tmp/family1/226d73716b3a4c4f9d456399ea2a0f1b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/226d73716b3a4c4f9d456399ea2a0f1b 2023-02-13 21:53:51,797 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in afec7cc7c29021c5831cdc083c828616/family1 of afec7cc7c29021c5831cdc083c828616 into 226d73716b3a4c4f9d456399ea2a0f1b(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:53:51,798 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for afec7cc7c29021c5831cdc083c828616: 2023-02-13 21:53:51,798 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676325231286; duration=0sec 2023-02-13 21:53:51,798 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:51,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/9260f958bcbb4acf93ef9797ef7baf25, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_] to archive 2023-02-13 21:53:51,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:51,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/ce41fdfbb1774ff3bed9258dabfab8bb 2023-02-13 21:53:51,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/9260f958bcbb4acf93ef9797ef7baf25 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/9260f958bcbb4acf93ef9797ef7baf25 2023-02-13 21:53:51,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/family1/0148b5d25b7e4fc8b2f718bdcdf49725_SeqId_47_ 2023-02-13 21:53:51,900 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:51,902 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => fce6abe7b13ac32476557d444266c845, NAME => 'testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:51,902 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5d0fe5464154a71daceb6ef4c970ed03, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:51,902 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2c06786eceaa7d933a7952e04a95eb29, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 5d0fe5464154a71daceb6ef4c970ed03, disabling compactions & flushes 2023-02-13 21:53:51,924 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. after waiting 0 ms 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:51,924 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:51,924 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 5d0fe5464154a71daceb6ef4c970ed03: Waiting for close lock at 1676325231924Disabling compacts and flushes for region at 1676325231924Disabling writes for close at 1676325231924Writing region close event to WAL at 1676325231924Closed at 1676325231924 2023-02-13 21:53:52,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:52,322 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing fce6abe7b13ac32476557d444266c845, disabling compactions & flushes 2023-02-13 21:53:52,323 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. after waiting 0 ms 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,323 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for fce6abe7b13ac32476557d444266c845: Waiting for close lock at 1676325232323Disabling compacts and flushes for region at 1676325232323Disabling writes for close at 1676325232323Writing region close event to WAL at 1676325232323Closed at 1676325232323 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 2c06786eceaa7d933a7952e04a95eb29, disabling compactions & flushes 2023-02-13 21:53:52,323 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. after waiting 0 ms 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,323 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,323 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 2c06786eceaa7d933a7952e04a95eb29: Waiting for close lock at 1676325232323Disabling compacts and flushes for region at 1676325232323Disabling writes for close at 1676325232323Writing region close event to WAL at 1676325232323Closed at 1676325232323 2023-02-13 21:53:52,326 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:52,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676325232326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325232326"}]},"ts":"1676325232326"} 2023-02-13 21:53:52,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325232326"}]},"ts":"1676325232326"} 2023-02-13 21:53:52,327 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325232326"}]},"ts":"1676325232326"} 2023-02-13 21:53:52,330 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 21:53:52,331 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:52,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325232331"}]},"ts":"1676325232331"} 2023-02-13 21:53:52,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-13 21:53:52,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fce6abe7b13ac32476557d444266c845, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d0fe5464154a71daceb6ef4c970ed03, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2c06786eceaa7d933a7952e04a95eb29, ASSIGN}] 2023-02-13 21:53:52,337 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d0fe5464154a71daceb6ef4c970ed03, ASSIGN 2023-02-13 21:53:52,337 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fce6abe7b13ac32476557d444266c845, ASSIGN 2023-02-13 21:53:52,337 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2c06786eceaa7d933a7952e04a95eb29, ASSIGN 2023-02-13 21:53:52,338 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2c06786eceaa7d933a7952e04a95eb29, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:52,338 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fce6abe7b13ac32476557d444266c845, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:52,338 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d0fe5464154a71daceb6ef4c970ed03, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:52,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5d0fe5464154a71daceb6ef4c970ed03, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,490 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fce6abe7b13ac32476557d444266c845, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,490 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2c06786eceaa7d933a7952e04a95eb29, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676325232489"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325232489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325232489"}]},"ts":"1676325232489"} 2023-02-13 21:53:52,490 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232489"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325232489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325232489"}]},"ts":"1676325232489"} 2023-02-13 21:53:52,490 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232490"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325232490"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325232490"}]},"ts":"1676325232490"} 2023-02-13 21:53:52,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 5d0fe5464154a71daceb6ef4c970ed03, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:52,493 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 2c06786eceaa7d933a7952e04a95eb29, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:52,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure fce6abe7b13ac32476557d444266c845, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:52,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:52,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:52,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5d0fe5464154a71daceb6ef4c970ed03, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 21:53:52,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:52,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,650 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,651 DEBUG [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/family1 2023-02-13 21:53:52,651 DEBUG [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/family1 2023-02-13 21:53:52,652 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d0fe5464154a71daceb6ef4c970ed03 columnFamilyName family1 2023-02-13 21:53:52,653 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] regionserver.HStore(310): Store=5d0fe5464154a71daceb6ef4c970ed03/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,653 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,654 DEBUG [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/family2 2023-02-13 21:53:52,655 DEBUG [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/family2 2023-02-13 21:53:52,655 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d0fe5464154a71daceb6ef4c970ed03 columnFamilyName family2 2023-02-13 21:53:52,657 INFO [StoreOpener-5d0fe5464154a71daceb6ef4c970ed03-1] regionserver.HStore(310): Store=5d0fe5464154a71daceb6ef4c970ed03/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:53:52,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:53:52,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:52,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5d0fe5464154a71daceb6ef4c970ed03; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59349942, jitterRate=-0.11561694741249084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:53:52,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5d0fe5464154a71daceb6ef4c970ed03: Running coprocessor pre-open hook at 1676325232649Writing region info on filesystem at 1676325232649Initializing all the Stores at 1676325232650 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232650Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232650Cleaning up temporary data from old regions at 1676325232659 (+9 ms)Cleaning up detritus from prior splits at 1676325232659Running coprocessor post-open hooks at 1676325232664 (+5 ms)Region opened successfully at 1676325232664 2023-02-13 21:53:52,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03., pid=31, masterSystemTime=1676325232645 2023-02-13 21:53:52,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:52,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:52,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2c06786eceaa7d933a7952e04a95eb29, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 21:53:52,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=5d0fe5464154a71daceb6ef4c970ed03, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676325232666"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325232666"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325232666"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325232666"}]},"ts":"1676325232666"} 2023-02-13 21:53:52,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:52,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,668 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,670 DEBUG [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1 2023-02-13 21:53:52,670 DEBUG [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1 2023-02-13 21:53:52,670 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c06786eceaa7d933a7952e04a95eb29 columnFamilyName family1 2023-02-13 21:53:52,672 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] regionserver.HStore(310): Store=2c06786eceaa7d933a7952e04a95eb29/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,672 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-13 21:53:52,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 5d0fe5464154a71daceb6ef4c970ed03, server=jenkins-hbase20.apache.org,34815,1676325186101 in 176 msec 2023-02-13 21:53:52,674 DEBUG [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family2 2023-02-13 21:53:52,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d0fe5464154a71daceb6ef4c970ed03, ASSIGN in 337 msec 2023-02-13 21:53:52,674 DEBUG [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family2 2023-02-13 21:53:52,675 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2c06786eceaa7d933a7952e04a95eb29 columnFamilyName family2 2023-02-13 21:53:52,676 INFO [StoreOpener-2c06786eceaa7d933a7952e04a95eb29-1] regionserver.HStore(310): Store=2c06786eceaa7d933a7952e04a95eb29/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:53:52,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:53:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:52,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 2c06786eceaa7d933a7952e04a95eb29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64127287, jitterRate=-0.04442895948886871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:53:52,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 2c06786eceaa7d933a7952e04a95eb29: Running coprocessor pre-open hook at 1676325232667Writing region info on filesystem at 1676325232667Initializing all the Stores at 1676325232668 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232668Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232668Cleaning up temporary data from old regions at 1676325232678 (+10 ms)Cleaning up detritus from prior splits at 1676325232678Running coprocessor post-open hooks at 1676325232682 (+4 ms)Region opened successfully at 1676325232682 2023-02-13 21:53:52,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29., pid=32, masterSystemTime=1676325232645 2023-02-13 21:53:52,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:52,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fce6abe7b13ac32476557d444266c845, NAME => 'testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 21:53:52,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,686 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=2c06786eceaa7d933a7952e04a95eb29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:52,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,686 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232685"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325232685"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325232685"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325232685"}]},"ts":"1676325232685"} 2023-02-13 21:53:52,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,689 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-13 21:53:52,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 2c06786eceaa7d933a7952e04a95eb29, server=jenkins-hbase20.apache.org,34815,1676325186101 in 195 msec 2023-02-13 21:53:52,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2c06786eceaa7d933a7952e04a95eb29, ASSIGN in 356 msec 2023-02-13 21:53:52,695 DEBUG [StoreOpener-fce6abe7b13ac32476557d444266c845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/family1 2023-02-13 21:53:52,696 DEBUG [StoreOpener-fce6abe7b13ac32476557d444266c845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/family1 2023-02-13 21:53:52,696 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce6abe7b13ac32476557d444266c845 columnFamilyName family1 2023-02-13 21:53:52,697 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] regionserver.HStore(310): Store=fce6abe7b13ac32476557d444266c845/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,698 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,699 DEBUG [StoreOpener-fce6abe7b13ac32476557d444266c845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/family2 2023-02-13 21:53:52,699 DEBUG [StoreOpener-fce6abe7b13ac32476557d444266c845-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/family2 2023-02-13 21:53:52,700 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce6abe7b13ac32476557d444266c845 columnFamilyName family2 2023-02-13 21:53:52,700 INFO [StoreOpener-fce6abe7b13ac32476557d444266c845-1] regionserver.HStore(310): Store=fce6abe7b13ac32476557d444266c845/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:52,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:53:52,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for fce6abe7b13ac32476557d444266c845 2023-02-13 21:53:52,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:52,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened fce6abe7b13ac32476557d444266c845; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62202321, jitterRate=-0.07311318814754486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:53:52,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for fce6abe7b13ac32476557d444266c845: Running coprocessor pre-open hook at 1676325232686Writing region info on filesystem at 1676325232686Initializing all the Stores at 1676325232688 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232689 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325232689Cleaning up temporary data from old regions at 1676325232702 (+13 ms)Cleaning up detritus from prior splits at 1676325232702Running coprocessor post-open hooks at 1676325232708 (+6 ms)Region opened successfully at 1676325232708 2023-02-13 21:53:52,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845., pid=33, masterSystemTime=1676325232645 2023-02-13 21:53:52,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:52,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fce6abe7b13ac32476557d444266c845, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:52,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676325232710"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325232710"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325232710"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325232710"}]},"ts":"1676325232710"} 2023-02-13 21:53:52,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-02-13 21:53:52,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure fce6abe7b13ac32476557d444266c845, server=jenkins-hbase20.apache.org,34815,1676325186101 in 218 msec 2023-02-13 21:53:52,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-13 21:53:52,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=fce6abe7b13ac32476557d444266c845, ASSIGN in 379 msec 2023-02-13 21:53:52,717 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:52,717 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325232717"}]},"ts":"1676325232717"} 2023-02-13 21:53:52,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-13 21:53:52,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:52,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2540 sec 2023-02-13 21:53:53,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-13 21:53:53,579 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-13 21:53:53,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:53,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,588 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 21:53:53,588 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:53,588 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 21:53:53,588 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 21:53:53,589 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,589 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,589 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:53,589 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:53,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:53,590 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:53,590 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:53,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:53,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:53,591 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 21:53:53,591 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:53,591 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 21:53:53,591 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:53,592 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. started... 2023-02-13 21:53:53,592 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:53:53,592 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:53,592 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:53,592 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2c06786eceaa7d933a7952e04a95eb29 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-13 21:53:53,592 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. started... 2023-02-13 21:53:53,592 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:53,593 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. started... 2023-02-13 21:53:53,593 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fce6abe7b13ac32476557d444266c845: 2023-02-13 21:53:53,593 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:53,593 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d0fe5464154a71daceb6ef4c970ed03: 2023-02-13 21:53:53,593 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:53:53,593 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:53,594 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:53:54,007 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213bec2d0a4874245cb9dc6215fbc681b49 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bec2d0a4874245cb9dc6215fbc681b49 2023-02-13 21:53:54,414 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp/family1/e8f7e2da66de483a832e469eecf54be5 2023-02-13 21:53:54,428 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp/family1/e8f7e2da66de483a832e469eecf54be5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5 2023-02-13 21:53:54,435 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 21:53:54,436 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 2c06786eceaa7d933a7952e04a95eb29 in 844ms, sequenceid=5, compaction requested=false 2023-02-13 21:53:54,436 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-13 21:53:54,437 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2c06786eceaa7d933a7952e04a95eb29: 2023-02-13 21:53:54,437 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:54,437 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:53:54,437 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:53:54,437 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,437 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 21:53:54,437 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 21:53:54,438 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,438 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:54,439 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,439 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 21:53:54,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f839b3a[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:54,441 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 21:53:54,441 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,441 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 21:53:54,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 21:53:54,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:54,442 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,442 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:54,443 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,443 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 21:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:54,443 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:54,443 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 21:53:54,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:54,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 21:53:54,446 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 21:53:54,446 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:54,446 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:54,446 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,446 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:54,447 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,447 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:54,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,447 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:54,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:54,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:54,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,449 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,451 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 21:53:54,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:54,452 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:54,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:54,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:54,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,552 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:54,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:54,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:54,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:54,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,566 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-13 21:53:54,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:54,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-13 21:53:54,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-13 21:53:54,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,568 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:54,568 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:54,569 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:54,569 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:54,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:54,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,571 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,571 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-13 21:53:54,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-13 21:53:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-13 21:53:54,572 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:54,572 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. started... 2023-02-13 21:53:54,572 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:54,572 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2c06786eceaa7d933a7952e04a95eb29 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-13 21:53:54,572 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:54,572 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. started... 2023-02-13 21:53:54,572 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:53:54,573 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for fce6abe7b13ac32476557d444266c845: 2023-02-13 21:53:54,573 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. started... 2023-02-13 21:53:54,573 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:53:54,573 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5d0fe5464154a71daceb6ef4c970ed03: 2023-02-13 21:53:54,573 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:54,573 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:53:54,573 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:53:54,574 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:53:54,990 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213181878e513114ca794d2f5e6a26abddb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213181878e513114ca794d2f5e6a26abddb 2023-02-13 21:53:55,395 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp/family1/c6edbfa6ce25401fbc23f96b588f9870 2023-02-13 21:53:55,400 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp/family1/c6edbfa6ce25401fbc23f96b588f9870 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870 2023-02-13 21:53:55,404 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870, entries=2, sequenceid=9, filesize=5.0 K 2023-02-13 21:53:55,405 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 2c06786eceaa7d933a7952e04a95eb29 in 833ms, sequenceid=9, compaction requested=false 2023-02-13 21:53:55,405 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2c06786eceaa7d933a7952e04a95eb29: 2023-02-13 21:53:55,405 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:55,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:53:55,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:53:55,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-13 21:53:55,405 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-13 21:53:55,407 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,407 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:55,407 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,407 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:55,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-13 21:53:55,408 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-13 21:53:55,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48329ab5[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:55,408 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,409 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,409 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-13 21:53:55,409 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-13 21:53:55,409 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:55,409 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,409 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:55,410 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-13 21:53:55,410 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,410 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,410 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-13 21:53:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:55,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:55,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-13 21:53:55,412 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-13 21:53:55,413 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:55,413 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:55,413 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,413 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:55,414 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,414 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:55,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,414 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:55,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:55,414 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:55,416 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,417 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-13 21:53:55,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,418 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:55,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-13 21:53:55,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,418 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:55,518 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:55,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:55,526 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-13 21:53:55,528 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 21:53:55,529 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 21:53:55,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:55,530 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325835530 2023-02-13 21:53:55,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:53:55,531 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-13 21:53:55,531 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 21:53:55,531 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x3eee8b67 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:53:55,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dbda3b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:53:55,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 21:53:56,363 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213b7044aedfb9540fc9013e73fcba885ba to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213b7044aedfb9540fc9013e73fcba885ba 2023-02-13 21:53:56,364 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 21:53:56,378 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:53:56,379 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50410, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:53:56,387 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:53:56,390 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43118, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:53:56,403 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7f08fbc8b34f49cbb4e001d4302b0381 first=Optional[k0] last=Optional[k1] 2023-02-13 21:53:56,404 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7f08fbc8b34f49cbb4e001d4302b0381}] 2023-02-13 21:53:56,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7f08fbc8b34f49cbb4e001d4302b0381 for inclusion in 2c06786eceaa7d933a7952e04a95eb29/family1 2023-02-13 21:53:56,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-13 21:53:56,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 21:53:56,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 2c06786eceaa7d933a7952e04a95eb29: 2023-02-13 21:53:56,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213/family1/7f08fbc8b34f49cbb4e001d4302b0381 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__hslnq0v1b7lc38t65hvj747vb84ri8dhb6tqgqmqetk7rlpflfr8mbi9t713aeor/family1/7f08fbc8b34f49cbb4e001d4302b0381 2023-02-13 21:53:56,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__hslnq0v1b7lc38t65hvj747vb84ri8dhb6tqgqmqetk7rlpflfr8mbi9t713aeor/family1/7f08fbc8b34f49cbb4e001d4302b0381 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_ 2023-02-13 21:53:56,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__hslnq0v1b7lc38t65hvj747vb84ri8dhb6tqgqmqetk7rlpflfr8mbi9t713aeor/family1/7f08fbc8b34f49cbb4e001d4302b0381 into 2c06786eceaa7d933a7952e04a95eb29/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_ - updating store file list. 2023-02-13 21:53:56,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_ into 2c06786eceaa7d933a7952e04a95eb29/family1 2023-02-13 21:53:56,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__hslnq0v1b7lc38t65hvj747vb84ri8dhb6tqgqmqetk7rlpflfr8mbi9t713aeor/family1/7f08fbc8b34f49cbb4e001d4302b0381 into 2c06786eceaa7d933a7952e04a95eb29/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_) 2023-02-13 21:53:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testScannerOnBulkLoadRefHFiles__hslnq0v1b7lc38t65hvj747vb84ri8dhb6tqgqmqetk7rlpflfr8mbi9t713aeor/family1/7f08fbc8b34f49cbb4e001d4302b0381 2023-02-13 21:53:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:53:56,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:53:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 2c06786eceaa7d933a7952e04a95eb29/family1 is initiating minor compaction (all files) 2023-02-13 21:53:56,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5783d1a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:56,423 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2c06786eceaa7d933a7952e04a95eb29/family1 in testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:53:56,423 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp, totalSize=15.1 K 2023-02-13 21:53:56,424 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting e8f7e2da66de483a832e469eecf54be5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325233579 2023-02-13 21:53:56,424 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting c6edbfa6ce25401fbc23f96b588f9870, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325233579 2023-02-13 21:53:56,427 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting fe4ce8e53839442b9e03627aed30759d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325233579 2023-02-13 21:53:56,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 21:53:56,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:56,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213181878e513114ca794d2f5e6a26abddb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213181878e513114ca794d2f5e6a26abddb 2023-02-13 21:53:56,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bec2d0a4874245cb9dc6215fbc681b49 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230213bec2d0a4874245cb9dc6215fbc681b49 2023-02-13 21:53:56,431 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-13 21:53:56,431 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 21:53:56,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-13 21:53:56,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-13 21:53:56,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:53:56,433 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-13 21:53:56,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 906 msec 2023-02-13 21:53:56,439 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2c06786eceaa7d933a7952e04a95eb29#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:53:56,470 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=246 (was 252), OpenFileDescriptor=591 (was 596), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 196) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=7286 (was 7656) 2023-02-13 21:53:56,480 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=246, OpenFileDescriptor=591, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=167, AvailableMemoryMB=7285 2023-02-13 21:53:56,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:53:56,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:56,486 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:53:56,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-13 21:53:56,487 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:53:56,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:56,488 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:56,488 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f empty. 2023-02-13 21:53:56,489 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:56,489 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-13 21:53:56,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:56,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:56,898 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 21:53:56,900 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5b7e5ba0bb2fea166e884933fad9757f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:53:57,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 5b7e5ba0bb2fea166e884933fad9757f, disabling compactions & flushes 2023-02-13 21:53:57,308 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. after waiting 0 ms 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,308 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,308 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 5b7e5ba0bb2fea166e884933fad9757f: Waiting for close lock at 1676325237308Disabling compacts and flushes for region at 1676325237308Disabling writes for close at 1676325237308Writing region close event to WAL at 1676325237308Closed at 1676325237308 2023-02-13 21:53:57,311 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:53:57,312 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325237312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325237312"}]},"ts":"1676325237312"} 2023-02-13 21:53:57,313 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:53:57,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:53:57,314 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325237314"}]},"ts":"1676325237314"} 2023-02-13 21:53:57,315 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-13 21:53:57,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=5b7e5ba0bb2fea166e884933fad9757f, ASSIGN}] 2023-02-13 21:53:57,319 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=5b7e5ba0bb2fea166e884933fad9757f, ASSIGN 2023-02-13 21:53:57,319 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=5b7e5ba0bb2fea166e884933fad9757f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:53:57,470 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5b7e5ba0bb2fea166e884933fad9757f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:57,471 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325237470"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325237470"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325237470"}]},"ts":"1676325237470"} 2023-02-13 21:53:57,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 5b7e5ba0bb2fea166e884933fad9757f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:53:57,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:57,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5b7e5ba0bb2fea166e884933fad9757f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:53:57,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:53:57,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,635 INFO [StoreOpener-5b7e5ba0bb2fea166e884933fad9757f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,637 DEBUG [StoreOpener-5b7e5ba0bb2fea166e884933fad9757f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:53:57,637 DEBUG [StoreOpener-5b7e5ba0bb2fea166e884933fad9757f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:53:57,637 INFO [StoreOpener-5b7e5ba0bb2fea166e884933fad9757f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b7e5ba0bb2fea166e884933fad9757f columnFamilyName family1 2023-02-13 21:53:57,640 INFO [StoreOpener-5b7e5ba0bb2fea166e884933fad9757f-1] regionserver.HStore(310): Store=5b7e5ba0bb2fea166e884933fad9757f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:53:57,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:53:57,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:53:57,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5b7e5ba0bb2fea166e884933fad9757f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59566999, jitterRate=-0.11238254606723785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:53:57,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5b7e5ba0bb2fea166e884933fad9757f: Running coprocessor pre-open hook at 1676325237628Writing region info on filesystem at 1676325237628Initializing all the Stores at 1676325237630 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325237630Cleaning up temporary data from old regions at 1676325237642 (+12 ms)Cleaning up detritus from prior splits at 1676325237642Running coprocessor post-open hooks at 1676325237647 (+5 ms)Region opened successfully at 1676325237647 2023-02-13 21:53:57,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f., pid=37, masterSystemTime=1676325237624 2023-02-13 21:53:57,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:57,651 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=5b7e5ba0bb2fea166e884933fad9757f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:57,651 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676325237651"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325237651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325237651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325237651"}]},"ts":"1676325237651"} 2023-02-13 21:53:57,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-13 21:53:57,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 5b7e5ba0bb2fea166e884933fad9757f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 181 msec 2023-02-13 21:53:57,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-13 21:53:57,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=5b7e5ba0bb2fea166e884933fad9757f, ASSIGN in 339 msec 2023-02-13 21:53:57,660 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:53:57,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325237660"}]},"ts":"1676325237660"} 2023-02-13 21:53:57,662 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-13 21:53:57,665 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/.tmp/family1/f94ad8e3ff5848099f6c71198ae4b667 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/f94ad8e3ff5848099f6c71198ae4b667 2023-02-13 21:53:57,665 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:53:57,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1820 sec 2023-02-13 21:53:57,671 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2c06786eceaa7d933a7952e04a95eb29/family1 of 2c06786eceaa7d933a7952e04a95eb29 into f94ad8e3ff5848099f6c71198ae4b667(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:53:57,672 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2c06786eceaa7d933a7952e04a95eb29: 2023-02-13 21:53:57,672 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676325236422; duration=1sec 2023-02-13 21:53:57,672 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:53:57,739 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_] to archive 2023-02-13 21:53:57,740 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:53:57,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/e8f7e2da66de483a832e469eecf54be5 2023-02-13 21:53:57,743 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/c6edbfa6ce25401fbc23f96b588f9870 2023-02-13 21:53:57,745 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/family1/fe4ce8e53839442b9e03627aed30759d_SeqId_12_ 2023-02-13 21:53:58,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:53:58,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-13 21:53:58,593 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-13 21:53:58,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:58,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,624 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:53:58,624 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:58,624 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:58,624 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:58,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,625 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:58,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:58,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:58,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:58,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,627 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:58,627 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:58,627 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:58,627 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:58,627 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:58,627 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:58,627 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:58,627 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:53:58,628 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:53:59,048 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b237406ad5c648488e4befbe45b556e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b237406ad5c648488e4befbe45b556e9 2023-02-13 21:53:59,452 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/c798affc26364caea21b7f89b2478dbb 2023-02-13 21:53:59,458 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/c798affc26364caea21b7f89b2478dbb as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb 2023-02-13 21:53:59,463 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-13 21:53:59,464 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 837ms, sequenceid=5, compaction requested=false 2023-02-13 21:53:59,464 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:53:59,465 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:53:59,465 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:59,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:53:59,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:53:59,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:53:59,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:53:59,466 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,466 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:59,466 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,466 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:53:59,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:59,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:53:59,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6efbbdc[Count = 0] remaining members to acquire global barrier 2023-02-13 21:53:59,468 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:53:59,468 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,468 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:53:59,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:53:59,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:53:59,469 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,469 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:53:59,470 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:53:59,470 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,470 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,470 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:53:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:59,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:53:59,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:53:59,473 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:53:59,473 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:53:59,473 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:53:59,473 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,473 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:53:59,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:53:59,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:53:59,475 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,479 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:53:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:59,481 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:53:59,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:53:59,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:53:59,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:53:59,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:53:59,481 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:53:59,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:53:59,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:53:59,582 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:53:59,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:53:59,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:53:59,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:53:59,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,591 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:53:59,591 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:59,592 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:53:59,592 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:53:59,592 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,592 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:53:59,594 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:53:59,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:53:59,594 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:53:59,595 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:53:59,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,595 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:53:59,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:53:59,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:53:59,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:53:59,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:53:59,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:53:59,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:53:59,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:53:59,597 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:53:59,597 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:53:59,597 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:54:00,015 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112877f0f33b2d0340718cd9e797f3f275e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112877f0f33b2d0340718cd9e797f3f275e9 2023-02-13 21:54:00,427 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/965b6652d1814dfaa10b6b838a2a5e36 2023-02-13 21:54:00,434 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/965b6652d1814dfaa10b6b838a2a5e36 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36 2023-02-13 21:54:00,439 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:54:00,439 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 842ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:00,440 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:00,440 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:00,440 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:00,440 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:00,440 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,440 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:00,440 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:00,441 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:00,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:00,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:00,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@616c85a5[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:00,443 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:00,443 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,445 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:00,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:00,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:00,446 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,446 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:00,447 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,447 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:00,447 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:00,447 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:00,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:00,448 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:00,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:00,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:00,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,449 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:00,449 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,449 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,450 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:00,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:00,450 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,451 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:00,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,452 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:00,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:00,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:00,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:00,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:00,453 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:00,453 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,453 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,453 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:00,453 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:00,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:00,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:00,553 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:00,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:00,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:00,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:00,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,563 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:00,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:00,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:00,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:00,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,564 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:00,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:00,564 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,565 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:00,565 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:00,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,566 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:00,566 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:00,566 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:00,566 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:00,566 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:00,566 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:00,566 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:00,566 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:00,567 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:00,982 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120101e4ab6d423f4b4da52938a9c0bedf18 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e4ab6d423f4b4da52938a9c0bedf18 2023-02-13 21:54:00,991 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/409cda6fe9f640a2a892f8a17d992173 2023-02-13 21:54:01,000 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/409cda6fe9f640a2a892f8a17d992173 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173 2023-02-13 21:54:01,010 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 21:54:01,011 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 444ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:01,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:01,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:01,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:01,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:01,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:01,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:01,012 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,012 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:01,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@421598f9[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:01,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:01,014 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:01,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:01,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:01,016 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,016 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:01,016 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:01,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:01,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:01,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:01,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:01,019 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:01,019 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:01,019 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:01,019 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,019 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:01,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:01,021 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,022 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:01,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:01,024 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:01,024 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:01,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:01,124 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:01,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:01,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:01,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:01,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,131 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:01,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:01,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:01,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:01,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,132 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,132 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:01,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:01,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:01,132 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,132 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,133 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:01,133 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,134 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:01,134 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:01,134 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:01,134 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:01,134 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:01,134 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:01,134 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:01,134 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:01,549 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120592259bb91ef34275933f1ba5c4c8e8db to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120592259bb91ef34275933f1ba5c4c8e8db 2023-02-13 21:54:01,957 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/907a50d8f58f40b1a553c8435bab01ab 2023-02-13 21:54:01,963 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/907a50d8f58f40b1a553c8435bab01ab as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab 2023-02-13 21:54:01,969 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 21:54:01,969 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 835ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:01,970 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:01,970 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:01,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:01,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:01,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:01,970 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:01,971 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,971 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,971 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,972 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:01,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e2e453c[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:01,973 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:01,973 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,974 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:01,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:01,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:01,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,975 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:01,975 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,976 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:01,976 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:01,976 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:01,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:01,978 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:01,978 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:01,978 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:01,978 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,978 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:01,980 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,980 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:01,980 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:01,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:01,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:01,982 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:01,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,984 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:01,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:01,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:01,984 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:01,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:01,985 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:01,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:02,085 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:02,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:02,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:02,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:02,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,095 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:02,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:02,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:02,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:02,100 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,100 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,102 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:02,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:02,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:02,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,103 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,104 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,104 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:02,104 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:02,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:02,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:02,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:02,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:02,105 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:02,105 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:02,105 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:02,551 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286c95e952e02c400cb68e96901b7cdf44 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286c95e952e02c400cb68e96901b7cdf44 2023-02-13 21:54:02,961 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/46c507e7db2441bdbabaad664ff2336e 2023-02-13 21:54:02,968 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/46c507e7db2441bdbabaad664ff2336e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e 2023-02-13 21:54:02,973 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 21:54:02,974 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 869ms, sequenceid=21, compaction requested=true 2023-02-13 21:54:02,974 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:02,974 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:02,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:02,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:02,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:02,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:02,975 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:02,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:02,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:02,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:02,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65643c7e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:02,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:02,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,978 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:02,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:02,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:02,979 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:02,980 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:02,980 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:02,980 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,981 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:02,981 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:02,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:02,984 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:02,985 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:02,985 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:02,985 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,985 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:02,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:02,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:02,989 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,993 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:02,999 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:02,999 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:03,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:03,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:03,000 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:03,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:03,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:03,001 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:03,001 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:03,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:03,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:03,101 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:03,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:03,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:03,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:03,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,111 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:03,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:03,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:03,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:03,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,113 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:03,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:03,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:03,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,115 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:03,115 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:03,115 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:03,115 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:03,116 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:03,116 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:03,116 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:03,116 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:03,130 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:54:03,168 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123116d93edf98bd495988863338430aa4a6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123116d93edf98bd495988863338430aa4a6 2023-02-13 21:54:03,585 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/3ddd45c0bce146d5b62bb7facb6ff950 2023-02-13 21:54:03,597 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/3ddd45c0bce146d5b62bb7facb6ff950 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950 2023-02-13 21:54:03,602 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 21:54:03,603 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 487ms, sequenceid=25, compaction requested=true 2023-02-13 21:54:03,603 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:03,603 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:03,603 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:03,603 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:03,603 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,603 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:03,603 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:03,605 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,605 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:03,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:03,606 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,606 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:03,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:03,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6020ccda[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:03,607 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:03,607 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,608 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,608 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:03,608 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:03,608 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:03,608 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,608 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:03,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:03,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:03,609 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:03,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:03,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:03,612 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:03,612 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:03,612 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:03,612 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,612 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:03,621 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,622 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:03,621 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:03,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:03,623 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:03,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,624 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:03,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,630 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:03,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:03,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:03,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:03,631 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:03,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:03,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:03,630 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:03,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:03,731 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:03,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:03,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:03,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:03,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,737 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:03,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:03,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:03,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:03,738 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,738 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,739 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:03,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:03,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:03,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:03,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,740 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,740 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:03,740 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:03,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:03,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:03,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:03,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:03,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:03,740 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:03,740 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:03,741 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:04,159 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016ab6ff9cf5254910945c3851b9e4c65d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601016ab6ff9cf5254910945c3851b9e4c65d 2023-02-13 21:54:04,566 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/b23d663273694f129e0258592891dda3 2023-02-13 21:54:04,571 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/b23d663273694f129e0258592891dda3 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3 2023-02-13 21:54:04,575 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 21:54:04,576 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 835ms, sequenceid=29, compaction requested=true 2023-02-13 21:54:04,576 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:04,576 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:04,576 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:04,576 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:04,576 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,576 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:04,576 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:04,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,577 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:04,577 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,577 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:04,578 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:04,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e1c5277[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:04,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,579 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:04,579 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:04,579 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:04,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:04,580 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:04,580 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,580 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:04,580 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:04,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:04,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:04,582 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:04,582 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:04,582 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:04,582 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,582 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:04,583 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,583 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,583 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:04,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:04,583 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:04,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,584 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:04,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:04,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:04,587 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:04,587 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:04,592 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:04,592 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:04,692 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:04,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:04,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:04,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:04,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,702 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:04,702 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:04,702 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:04,702 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:04,702 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,703 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:04,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:04,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:04,704 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:04,704 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:04,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,704 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,705 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:04,705 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:04,705 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:04,705 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:04,705 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:04,705 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:04,705 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:04,705 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:04,705 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:04,705 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:05,123 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103caea51cf12d042bf8c74fc606841efb3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103caea51cf12d042bf8c74fc606841efb3 2023-02-13 21:54:05,533 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd 2023-02-13 21:54:05,539 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd 2023-02-13 21:54:05,546 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 21:54:05,547 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 842ms, sequenceid=33, compaction requested=true 2023-02-13 21:54:05,547 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:05,547 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:05,547 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:05,547 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:05,547 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,548 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:05,548 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:05,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:05,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:05,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:05,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:05,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62f7f12d[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:05,550 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:05,550 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,551 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,551 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:05,551 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:05,551 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:05,551 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,551 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:05,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:05,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:05,554 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:05,554 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:05,554 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:05,554 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,554 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:05,555 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,555 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,555 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:05,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:05,556 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,558 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:05,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:05,558 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:05,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:05,658 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:05,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:05,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,665 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:05,665 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:05,665 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:05,665 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:05,666 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,666 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:05,669 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:05,669 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:05,669 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,670 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:05,670 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:05,670 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:05,670 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:05,670 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:05,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:05,671 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:05,671 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:05,671 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:06,092 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509071de34c6959fc4540a57d244c218b8bdf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509071de34c6959fc4540a57d244c218b8bdf 2023-02-13 21:54:06,503 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/55d31f55249c458b903de3404305d3da 2023-02-13 21:54:06,511 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/55d31f55249c458b903de3404305d3da as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da 2023-02-13 21:54:06,515 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 21:54:06,516 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 845ms, sequenceid=37, compaction requested=true 2023-02-13 21:54:06,517 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:06,517 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:06,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:06,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:06,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:06,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:06,518 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,518 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:06,518 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,518 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:06,519 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:06,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b4a6c1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:06,519 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,520 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,520 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:06,520 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,520 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:06,520 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:06,520 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:06,521 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:06,521 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,521 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:06,521 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:06,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:06,523 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:06,523 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:06,523 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:06,523 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,523 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:06,524 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:06,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:06,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,524 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,525 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:06,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,526 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,526 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:06,526 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,526 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:06,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:06,526 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:06,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:06,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:06,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:06,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:06,526 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:06,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:06,527 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,627 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:06,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:06,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:06,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:06,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,635 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:06,635 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:06,635 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-13 21:54:06,635 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-13 21:54:06,636 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,636 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,636 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,636 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:06,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:06,637 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:06,637 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,637 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,638 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-13 21:54:06,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:06,638 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-13 21:54:06,638 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:06,638 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-13 21:54:06,638 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:06,638 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:06,638 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:06,638 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. started... 2023-02-13 21:54:06,638 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5b7e5ba0bb2fea166e884933fad9757f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:07,068 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112067427ebd8fb74c9aab779a4cf53272b1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112067427ebd8fb74c9aab779a4cf53272b1 2023-02-13 21:54:07,476 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/0b47697d45f540ec9f0e74c4e2c9985a 2023-02-13 21:54:07,481 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/0b47697d45f540ec9f0e74c4e2c9985a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a 2023-02-13 21:54:07,485 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 21:54:07,486 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5b7e5ba0bb2fea166e884933fad9757f in 848ms, sequenceid=41, compaction requested=true 2023-02-13 21:54:07,486 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:07,486 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:07,486 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:07,486 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:07,486 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,487 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-13 21:54:07,487 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-13 21:54:07,488 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,488 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:07,488 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,488 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:07,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-13 21:54:07,489 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-13 21:54:07,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4014f8d1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:07,489 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,490 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,490 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-13 21:54:07,490 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-13 21:54:07,490 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:07,490 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,490 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:07,491 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,491 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-13 21:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:07,491 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:07,491 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-13 21:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:07,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:07,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:54:07,493 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-13 21:54:07,493 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:07,493 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:07,493 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,493 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:07,494 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,494 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:07,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,494 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:07,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:07,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:07,494 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,495 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:07,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,497 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:07,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:07,498 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:07,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-13 21:54:07,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:07,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:07,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-13 21:54:07,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:07,498 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:07,498 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:07,598 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:07,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:07,600 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-13 21:54:07,602 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:54:07,603 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:54:07,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:07,604 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325847604 2023-02-13 21:54:07,606 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:07,607 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-13 21:54:07,607 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:07,607 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x3ef9b0c0 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:07,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ee9348c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:07,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,481 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103274e9de5a137406c905691307ba5e147 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103274e9de5a137406c905691307ba5e147 2023-02-13 21:54:08,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:08,498 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:08,500 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41522, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:08,507 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:08,508 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:08,519 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fdb725d5164023998752fcb093134b first=Optional[r3] last=Optional[r6] 2023-02-13 21:54:08,519 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fdb725d5164023998752fcb093134b}] 2023-02-13 21:54:08,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fdb725d5164023998752fcb093134b for inclusion in 5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:54:08,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 21:54:08,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:08,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:08,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/89fdb725d5164023998752fcb093134b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6f8bfra92k5hjl2bv83gb040o5h680f48ufjc0s7g06df5u3io9bv89u15chrc6o/family1/89fdb725d5164023998752fcb093134b 2023-02-13 21:54:08,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6f8bfra92k5hjl2bv83gb040o5h680f48ufjc0s7g06df5u3io9bv89u15chrc6o/family1/89fdb725d5164023998752fcb093134b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_ 2023-02-13 21:54:08,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6f8bfra92k5hjl2bv83gb040o5h680f48ufjc0s7g06df5u3io9bv89u15chrc6o/family1/89fdb725d5164023998752fcb093134b into 5b7e5ba0bb2fea166e884933fad9757f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_ - updating store file list. 2023-02-13 21:54:08,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_ into 5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:54:08,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6f8bfra92k5hjl2bv83gb040o5h680f48ufjc0s7g06df5u3io9bv89u15chrc6o/family1/89fdb725d5164023998752fcb093134b into 5b7e5ba0bb2fea166e884933fad9757f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_) 2023-02-13 21:54:08,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6f8bfra92k5hjl2bv83gb040o5h680f48ufjc0s7g06df5u3io9bv89u15chrc6o/family1/89fdb725d5164023998752fcb093134b 2023-02-13 21:54:08,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:54:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:54:08,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 5b7e5ba0bb2fea166e884933fad9757f/family1 is initiating minor compaction 2023-02-13 21:54:08,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@29472001; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:08,543 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 5b7e5ba0bb2fea166e884933fad9757f/family1 in testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:08,543 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp, totalSize=50.0 K 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 965b6652d1814dfaa10b6b838a2a5e36, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 409cda6fe9f640a2a892f8a17d992173, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 907a50d8f58f40b1a553c8435bab01ab, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 46c507e7db2441bdbabaad664ff2336e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 3ddd45c0bce146d5b62bb7facb6ff950, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting b23d663273694f129e0258592891dda3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting ea1a32dc59ef4ad5b1f4b0153973c9fd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:54:08,543 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 55d31f55249c458b903de3404305d3da, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:54:08,544 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 0b47697d45f540ec9f0e74c4e2c9985a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:54:08,544 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 0282586cd7194a9d9c027735b28650c5_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:54:08,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:08,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:08,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286c95e952e02c400cb68e96901b7cdf44 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286c95e952e02c400cb68e96901b7cdf44 2023-02-13 21:54:08,561 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123116d93edf98bd495988863338430aa4a6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123116d93edf98bd495988863338430aa4a6 2023-02-13 21:54:08,566 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601016ab6ff9cf5254910945c3851b9e4c65d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601016ab6ff9cf5254910945c3851b9e4c65d 2023-02-13 21:54:08,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103caea51cf12d042bf8c74fc606841efb3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103caea51cf12d042bf8c74fc606841efb3 2023-02-13 21:54:08,568 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-13 21:54:08,568 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:08,608 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] throttle.PressureAwareThroughputController(145): 5b7e5ba0bb2fea166e884933fad9757f#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:09,432 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/568e34544d8c4a02829bded9aae1e451 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/568e34544d8c4a02829bded9aae1e451 2023-02-13 21:54:09,440 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5b7e5ba0bb2fea166e884933fad9757f/family1 of 5b7e5ba0bb2fea166e884933fad9757f into 568e34544d8c4a02829bded9aae1e451(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:09,440 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:09,440 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676325248543; duration=0sec 2023-02-13 21:54:09,441 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:09,444 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205840c8dc2f17b45b9bb4373008c6fc90f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205840c8dc2f17b45b9bb4373008c6fc90f 2023-02-13 21:54:09,445 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:09,471 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b00f8551e104d4589ad7c77b5234a2f first=Optional[r00] last=Optional[r2] 2023-02-13 21:54:09,472 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b00f8551e104d4589ad7c77b5234a2f}] 2023-02-13 21:54:09,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b00f8551e104d4589ad7c77b5234a2f for inclusion in 5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:54:09,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 21:54:09,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:09,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/7b00f8551e104d4589ad7c77b5234a2f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__o7r859lg6sruhl2v54l7auvvs5oser0i1d4f8ibkh0lto4un3c96k68kukhltvkr/family1/7b00f8551e104d4589ad7c77b5234a2f 2023-02-13 21:54:09,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__o7r859lg6sruhl2v54l7auvvs5oser0i1d4f8ibkh0lto4un3c96k68kukhltvkr/family1/7b00f8551e104d4589ad7c77b5234a2f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_ 2023-02-13 21:54:09,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__o7r859lg6sruhl2v54l7auvvs5oser0i1d4f8ibkh0lto4un3c96k68kukhltvkr/family1/7b00f8551e104d4589ad7c77b5234a2f into 5b7e5ba0bb2fea166e884933fad9757f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_ - updating store file list. 2023-02-13 21:54:09,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_ into 5b7e5ba0bb2fea166e884933fad9757f/family1 2023-02-13 21:54:09,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__o7r859lg6sruhl2v54l7auvvs5oser0i1d4f8ibkh0lto4un3c96k68kukhltvkr/family1/7b00f8551e104d4589ad7c77b5234a2f into 5b7e5ba0bb2fea166e884933fad9757f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_) 2023-02-13 21:54:09,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyPolicy__o7r859lg6sruhl2v54l7auvvs5oser0i1d4f8ibkh0lto4un3c96k68kukhltvkr/family1/7b00f8551e104d4589ad7c77b5234a2f 2023-02-13 21:54:09,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:54:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:54:09,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 5b7e5ba0bb2fea166e884933fad9757f/family1 is initiating minor compaction (all files) 2023-02-13 21:54:09,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35f655f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:09,491 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5b7e5ba0bb2fea166e884933fad9757f/family1 in testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:54:09,491 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/568e34544d8c4a02829bded9aae1e451, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp, totalSize=337.0 K 2023-02-13 21:54:09,491 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting c798affc26364caea21b7f89b2478dbb, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:54:09,492 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 568e34544d8c4a02829bded9aae1e451, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:54:09,493 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809985 2023-02-13 21:54:09,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:09,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:09,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b237406ad5c648488e4befbe45b556e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130b237406ad5c648488e4befbe45b556e9 2023-02-13 21:54:09,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e4ab6d423f4b4da52938a9c0bedf18 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120101e4ab6d423f4b4da52938a9c0bedf18 2023-02-13 21:54:09,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120592259bb91ef34275933f1ba5c4c8e8db to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120592259bb91ef34275933f1ba5c4c8e8db 2023-02-13 21:54:09,500 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-13 21:54:09,500 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 21:54:09,501 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-13 21:54:09,501 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-13 21:54:09,501 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:09,502 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:54:09,504 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.9010 sec 2023-02-13 21:54:09,512 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5b7e5ba0bb2fea166e884933fad9757f#family1#compaction#50 average throughput is 25.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:09,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_] to archive 2023-02-13 21:54:09,539 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:09,541 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/965b6652d1814dfaa10b6b838a2a5e36 2023-02-13 21:54:09,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/409cda6fe9f640a2a892f8a17d992173 2023-02-13 21:54:09,543 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 35 more 2023-02-13 21:54:09,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/907a50d8f58f40b1a553c8435bab01ab 2023-02-13 21:54:09,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/46c507e7db2441bdbabaad664ff2336e 2023-02-13 21:54:09,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/3ddd45c0bce146d5b62bb7facb6ff950 2023-02-13 21:54:09,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/b23d663273694f129e0258592891dda3 2023-02-13 21:54:09,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/ea1a32dc59ef4ad5b1f4b0153973c9fd 2023-02-13 21:54:09,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/55d31f55249c458b903de3404305d3da 2023-02-13 21:54:09,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0b47697d45f540ec9f0e74c4e2c9985a 2023-02-13 21:54:09,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/0282586cd7194a9d9c027735b28650c5_SeqId_44_ 2023-02-13 21:54:09,601 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253 (was 246) - Thread LEAK? -, OpenFileDescriptor=615 (was 591) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=248 (was 204) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 167), AvailableMemoryMB=6686 (was 7285) 2023-02-13 21:54:09,614 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=248, ProcessCount=165, AvailableMemoryMB=6686 2023-02-13 21:54:09,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:54:09,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:09,619 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:54:09,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-13 21:54:09,619 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:54:09,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 21:54:09,621 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,621 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 empty. 2023-02-13 21:54:09,622 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,622 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-13 21:54:09,635 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:09,636 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f04de91d0e8a4ca6aaa34d6a7278404, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 5f04de91d0e8a4ca6aaa34d6a7278404, disabling compactions & flushes 2023-02-13 21:54:09,651 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. after waiting 0 ms 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:09,651 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:09,651 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Waiting for close lock at 1676325249651Disabling compacts and flushes for region at 1676325249651Disabling writes for close at 1676325249651Writing region close event to WAL at 1676325249651Closed at 1676325249651 2023-02-13 21:54:09,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:54:09,656 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325249655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325249655"}]},"ts":"1676325249655"} 2023-02-13 21:54:09,657 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:54:09,658 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:54:09,658 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325249658"}]},"ts":"1676325249658"} 2023-02-13 21:54:09,659 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-13 21:54:09,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, ASSIGN}] 2023-02-13 21:54:09,664 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, ASSIGN 2023-02-13 21:54:09,675 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:09,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 21:54:09,827 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:09,827 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325249827"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325249827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325249827"}]},"ts":"1676325249827"} 2023-02-13 21:54:09,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:09,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 21:54:09,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:09,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f04de91d0e8a4ca6aaa34d6a7278404, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:09,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:09,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,992 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,994 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:09,994 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:09,995 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f04de91d0e8a4ca6aaa34d6a7278404 columnFamilyName family1 2023-02-13 21:54:09,997 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(310): Store=5f04de91d0e8a4ca6aaa34d6a7278404/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:09,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:09,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:10,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:10,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:10,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5f04de91d0e8a4ca6aaa34d6a7278404; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62135748, jitterRate=-0.07410520315170288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:10,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Running coprocessor pre-open hook at 1676325249989Writing region info on filesystem at 1676325249989Initializing all the Stores at 1676325249991 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325249991Cleaning up temporary data from old regions at 1676325250000 (+9 ms)Cleaning up detritus from prior splits at 1676325250001 (+1 ms)Running coprocessor post-open hooks at 1676325250008 (+7 ms)Region opened successfully at 1676325250008 2023-02-13 21:54:10,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., pid=41, masterSystemTime=1676325249981 2023-02-13 21:54:10,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:10,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:10,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:10,012 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325250012"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325250012"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325250012"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325250012"}]},"ts":"1676325250012"} 2023-02-13 21:54:10,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-13 21:54:10,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101 in 185 msec 2023-02-13 21:54:10,017 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-13 21:54:10,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, ASSIGN in 354 msec 2023-02-13 21:54:10,018 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:54:10,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325250018"}]},"ts":"1676325250018"} 2023-02-13 21:54:10,020 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-13 21:54:10,022 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:54:10,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 406 msec 2023-02-13 21:54:10,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-13 21:54:10,224 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-13 21:54:10,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:10,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,254 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:10,254 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:10,254 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:10,254 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:10,255 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,255 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,256 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:10,256 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:10,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:10,256 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:10,256 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:10,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,257 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:10,257 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:10,257 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:10,257 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:10,257 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:10,257 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:10,257 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:10,257 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:10,258 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:54:10,676 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f46dd6e718fd4719928ca9eaf204b3b5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f46dd6e718fd4719928ca9eaf204b3b5 2023-02-13 21:54:10,734 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/.tmp/family1/1fc614a2d6394e9c8ee95d804a8fb328 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/1fc614a2d6394e9c8ee95d804a8fb328 2023-02-13 21:54:10,741 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5b7e5ba0bb2fea166e884933fad9757f/family1 of 5b7e5ba0bb2fea166e884933fad9757f into 1fc614a2d6394e9c8ee95d804a8fb328(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:54:10,741 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5b7e5ba0bb2fea166e884933fad9757f: 2023-02-13 21:54:10,742 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676325249490; duration=1sec 2023-02-13 21:54:10,742 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:10,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/568e34544d8c4a02829bded9aae1e451, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_] to archive 2023-02-13 21:54:10,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:10,842 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/c798affc26364caea21b7f89b2478dbb 2023-02-13 21:54:10,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/568e34544d8c4a02829bded9aae1e451 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/568e34544d8c4a02829bded9aae1e451 2023-02-13 21:54:10,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/family1/d86bf8e9ca6840b8b8f773ed1be40773_SeqId_47_ 2023-02-13 21:54:11,081 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/650a9c756c9e409dafab1b77ab130d5c 2023-02-13 21:54:11,087 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/650a9c756c9e409dafab1b77ab130d5c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c 2023-02-13 21:54:11,091 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-13 21:54:11,092 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 834ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:11,092 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:11,093 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:11,093 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:11,093 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:11,095 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,095 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,095 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,095 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:11,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c77854e[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:11,096 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:11,096 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,097 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:11,097 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:11,097 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,097 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:11,098 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,098 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,098 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,098 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:11,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:11,100 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:11,100 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:11,100 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:11,100 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,100 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:11,101 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,101 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,101 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:11,102 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,102 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:11,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:11,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:11,104 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:11,105 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:11,105 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:11,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:11,105 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,205 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:11,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:11,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,211 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:11,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:11,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:11,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:11,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,213 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:11,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:11,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:11,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:11,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:11,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,215 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:11,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:11,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:11,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:11,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:11,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:11,215 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:11,215 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:11,215 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:54:11,229 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128705548efdc654da3b65af1ba4d3a3a6e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128705548efdc654da3b65af1ba4d3a3a6e 2023-02-13 21:54:11,639 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/2fcd8f8ca7f14814b61eb4f059c4832e 2023-02-13 21:54:11,651 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/2fcd8f8ca7f14814b61eb4f059c4832e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e 2023-02-13 21:54:11,656 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:54:11,656 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 441ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:11,657 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:11,657 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:11,657 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:11,658 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,659 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,659 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:11,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71546774[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:11,660 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:11,660 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,660 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:11,661 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,661 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:11,661 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,661 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:11,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:11,664 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:11,664 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:11,664 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:11,664 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,664 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:11,665 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,665 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:11,665 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:11,665 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,666 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:11,669 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:11,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:11,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:11,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:11,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:11,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:11,669 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:11,769 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:11,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:11,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:11,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:11,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,782 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:11,782 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:11,783 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:11,783 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:11,783 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,783 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,785 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,785 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:11,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:11,785 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:11,785 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:11,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:11,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:11,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:11,787 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:11,787 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:11,787 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:11,787 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:11,787 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:11,787 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:11,787 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:11,787 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:12,201 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018189a3e672e040fea558c8e848dcb834 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018189a3e672e040fea558c8e848dcb834 2023-02-13 21:54:12,608 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/50f4df6015674c4cb8bd05c1091b4363 2023-02-13 21:54:12,612 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/50f4df6015674c4cb8bd05c1091b4363 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363 2023-02-13 21:54:12,616 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 21:54:12,617 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 830ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:12,617 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:12,617 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:12,617 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:12,617 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:12,617 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,617 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:12,617 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:12,618 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,619 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,619 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:12,620 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:12,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:12,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72554531[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:12,622 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:12,622 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,623 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:12,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:12,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:12,623 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,623 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:12,624 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,624 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:12,624 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:12,624 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:12,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:12,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:12,626 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:12,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:12,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:12,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,626 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:12,626 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,626 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:12,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,627 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,627 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:12,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,629 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:12,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:12,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:12,631 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:12,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:12,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:12,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:12,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:12,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,631 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:12,731 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:12,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:12,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:12,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:12,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,737 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:12,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:12,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:12,737 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:12,738 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,738 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,738 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:12,738 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:12,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:12,739 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:12,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:12,740 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:12,740 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:12,740 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:13,153 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120504fd96477c5a42e9ab30ab2453f435a8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120504fd96477c5a42e9ab30ab2453f435a8 2023-02-13 21:54:13,571 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/a04455b77dac4fd4abf9d3a8aa99d058 2023-02-13 21:54:13,576 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/a04455b77dac4fd4abf9d3a8aa99d058 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058 2023-02-13 21:54:13,580 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 21:54:13,581 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 841ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:13,581 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:13,581 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:13,581 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:13,581 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:13,581 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,581 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:13,581 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:13,583 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:13,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:13,584 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15e0f9da[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:13,584 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:13,584 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,585 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,585 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:13,585 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,585 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:13,585 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:13,585 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:13,586 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,586 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,586 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:13,586 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:13,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:13,588 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:13,588 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:13,589 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:13,589 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,589 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:13,590 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,590 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:13,590 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:13,590 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,592 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,593 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,593 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:13,593 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,594 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:13,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:13,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:13,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:13,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:13,594 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:13,694 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:13,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:13,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:13,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,700 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:13,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:13,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:13,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:13,700 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,701 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,703 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:13,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:13,703 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,703 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,704 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:13,704 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:13,704 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:13,704 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:13,704 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:13,704 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:13,704 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:13,704 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:13,704 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:13,704 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:14,117 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a7a254cbd9bd462ca25030f4d4709a66 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a7a254cbd9bd462ca25030f4d4709a66 2023-02-13 21:54:14,525 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/72ae6c1f4ae7494d98bb3e465836e62b 2023-02-13 21:54:14,530 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/72ae6c1f4ae7494d98bb3e465836e62b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b 2023-02-13 21:54:14,535 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 21:54:14,536 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 832ms, sequenceid=21, compaction requested=true 2023-02-13 21:54:14,536 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:14,537 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:14,537 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:14,537 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:14,537 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,537 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:14,537 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:14,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,538 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:14,538 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,538 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:14,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:14,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52d43dd[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:14,539 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:14,539 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,540 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,540 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:14,540 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:14,540 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,540 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:14,540 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:14,541 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:14,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:14,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:14,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:14,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:14,543 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:14,543 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:14,543 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:14,543 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,543 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:14,544 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,544 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:14,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,544 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:14,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:14,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:14,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:14,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,547 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:14,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:14,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:14,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:14,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:14,549 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:14,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:14,550 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:14,550 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:14,650 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:14,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:14,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:14,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:14,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,657 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:14,657 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:14,657 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:14,657 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:14,657 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,657 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,658 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:14,658 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:14,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:14,659 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:14,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,659 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:14,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:14,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:14,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:14,660 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:14,660 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:14,660 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:14,660 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:14,660 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:14,660 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:14,660 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:14,661 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:15,042 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:15,042 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50feb929 to 127.0.0.1:60489 2023-02-13 21:54:15,042 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:15,045 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:15,045 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3eee8b67 to 127.0.0.1:60489 2023-02-13 21:54:15,045 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:15,048 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:15,048 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ef9b0c0 to 127.0.0.1:60489 2023-02-13 21:54:15,048 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:15,077 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123154263761db7849be8bb15f5238b37219 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123154263761db7849be8bb15f5238b37219 2023-02-13 21:54:15,484 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/3aa256c838d04aaa9abee710ac5e4fb4 2023-02-13 21:54:15,490 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/3aa256c838d04aaa9abee710ac5e4fb4 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4 2023-02-13 21:54:15,497 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 21:54:15,498 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 837ms, sequenceid=25, compaction requested=true 2023-02-13 21:54:15,498 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:15,498 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:15,498 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:15,498 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:15,498 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,498 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:15,498 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:15,499 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,499 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:15,500 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,500 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:15,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:15,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:15,501 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5790ebcb[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:15,501 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:15,502 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,502 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,502 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:15,502 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:15,502 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,503 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:15,503 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:15,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,504 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:15,504 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:15,504 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:15,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:15,507 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:15,507 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:15,507 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:15,507 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,507 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:15,508 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,508 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,508 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:15,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:15,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:15,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:15,509 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,510 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,512 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:15,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:15,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:15,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:15,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:15,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:15,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,513 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:15,513 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,549 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:54:15,613 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:15,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:15,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:15,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:15,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,620 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:15,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:15,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:15,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:15,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,621 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,621 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:15,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:15,621 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:15,622 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,622 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:15,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:15,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:15,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:15,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:15,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:15,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:15,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:15,623 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:15,623 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:15,623 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:16,037 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010187aba71a9670484783b3cd9b540f2d93 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010187aba71a9670484783b3cd9b540f2d93 2023-02-13 21:54:16,043 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/b3b0552de92546e1806bcfd64c23c80b 2023-02-13 21:54:16,053 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/b3b0552de92546e1806bcfd64c23c80b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b 2023-02-13 21:54:16,062 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 21:54:16,062 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 439ms, sequenceid=29, compaction requested=true 2023-02-13 21:54:16,062 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:16,062 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:16,062 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:16,063 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:16,063 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,063 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:16,063 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:16,084 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,084 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,084 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,084 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:16,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb440c5[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:16,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:16,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,086 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,087 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:16,087 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:16,087 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,087 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:16,087 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:16,089 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,089 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,089 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:16,089 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:16,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:16,092 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:16,092 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:16,092 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:16,092 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,092 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:16,093 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,093 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,093 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:16,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,094 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,103 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,103 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:16,103 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:16,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:16,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:16,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:16,103 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:16,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:16,103 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:16,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:16,204 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:16,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:16,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:16,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:16,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,211 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:16,211 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:16,211 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:16,211 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:16,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,213 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:16,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:16,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:16,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:16,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,214 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:16,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:16,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:16,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:16,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:16,215 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:16,215 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:16,215 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:16,215 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:16,229 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c0aa1dad881b44d5a232c12fd0848461 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c0aa1dad881b44d5a232c12fd0848461 2023-02-13 21:54:16,634 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/7787a21bf76d49218340adffa51611a0 2023-02-13 21:54:16,639 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/7787a21bf76d49218340adffa51611a0 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0 2023-02-13 21:54:16,642 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 21:54:16,643 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 428ms, sequenceid=33, compaction requested=true 2023-02-13 21:54:16,643 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:16,643 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:16,643 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:16,643 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:16,643 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,643 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:16,643 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:16,644 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,644 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,645 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,645 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:16,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d0856c0[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:16,646 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:16,646 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,646 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,646 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:16,646 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:16,646 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,647 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:16,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:16,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:16,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:16,647 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:16,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:16,649 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:16,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:16,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:16,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,649 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:16,650 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,650 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,650 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:16,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:16,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:16,651 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,652 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,653 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,653 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:16,653 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,653 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:16,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:16,653 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:16,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:16,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:16,654 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:16,653 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:16,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:16,654 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:16,754 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:16,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:16,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:16,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:16,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,760 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:16,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:16,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:16,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:16,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,760 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,761 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:16,761 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:16,762 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:16,762 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:16,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:16,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:16,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:16,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:16,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:16,763 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:16,763 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:16,763 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:16,763 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:17,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bb161b61c170412f91f0894bfe74656b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907bb161b61c170412f91f0894bfe74656b 2023-02-13 21:54:17,583 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/ba05ca1bbb9549a689126f9aa3358a57 2023-02-13 21:54:17,590 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/ba05ca1bbb9549a689126f9aa3358a57 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57 2023-02-13 21:54:17,595 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 21:54:17,596 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 833ms, sequenceid=37, compaction requested=true 2023-02-13 21:54:17,596 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:17,596 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:17,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:17,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:17,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:17,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:17,597 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:17,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:17,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,598 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:17,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:17,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7254cd17[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:17,599 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:17,599 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,599 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:17,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:17,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:17,600 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,600 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:17,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:17,600 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:17,601 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:17,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:17,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:17,603 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:17,603 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:17,603 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:17,603 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,603 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:17,604 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,604 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,604 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:17,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:17,604 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:17,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:17,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:17,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:17,606 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:17,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,609 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:17,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:17,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:17,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:17,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-13 21:54:17,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:17,609 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:17,710 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:17,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:17,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:17,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:17,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,720 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:17,721 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:17,721 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-13 21:54:17,721 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-13 21:54:17,721 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,721 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,722 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:17,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:17,722 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,722 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:17,723 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:17,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:17,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,723 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,735 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-13 21:54:17,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:17,735 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-13 21:54:17,735 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:17,735 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-13 21:54:17,735 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:17,735 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:17,735 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:17,735 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. started... 2023-02-13 21:54:17,735 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f04de91d0e8a4ca6aaa34d6a7278404 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:17,756 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208f1e227c073441a2ac0184d0e9207b2d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208f1e227c073441a2ac0184d0e9207b2d 2023-02-13 21:54:18,161 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/62560a5221d04f68ab1b04d7b6d9f533 2023-02-13 21:54:18,168 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/62560a5221d04f68ab1b04d7b6d9f533 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533 2023-02-13 21:54:18,174 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 21:54:18,175 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5f04de91d0e8a4ca6aaa34d6a7278404 in 440ms, sequenceid=41, compaction requested=true 2023-02-13 21:54:18,175 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:18,175 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-13 21:54:18,175 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-13 21:54:18,176 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,176 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:18,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:18,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-13 21:54:18,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22cabe25[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:18,178 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-13 21:54:18,178 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,179 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,179 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-13 21:54:18,179 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-13 21:54:18,179 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:18,179 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,179 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:18,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-13 21:54:18,180 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:18,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:18,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:18,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-13 21:54:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:18,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:18,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-13 21:54:18,183 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-13 21:54:18,183 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:18,183 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:18,183 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,183 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:18,185 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,185 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:18,185 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:18,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:18,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:18,186 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:18,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,187 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,189 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:18,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-13 21:54:18,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:18,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:18,190 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:18,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:18,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:18,290 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:18,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:18,292 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:18,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:18,294 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:18,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:18,295 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325858295 2023-02-13 21:54:18,296 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:18,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 21:54:18,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:18,298 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x1ed86974 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:18,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59526377, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:18,302 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,164 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036e59d0b5c7b64c029cd4dfff4231127a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601036e59d0b5c7b64c029cd4dfff4231127a 2023-02-13 21:54:19,166 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:19,179 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:19,181 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:19,188 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:19,191 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57668, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:19,205 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2656980cd9174509a06d2d79d7a96e26 first=Optional[r3] last=Optional[r6] 2023-02-13 21:54:19,206 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2656980cd9174509a06d2d79d7a96e26}] 2023-02-13 21:54:19,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2656980cd9174509a06d2d79d7a96e26 for inclusion in 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:19,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 21:54:19,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:19,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:19,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2656980cd9174509a06d2d79d7a96e26 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gejldivdq8ri1922cdkl485ersajqpa0brbormovbn3qfv486hrghq5m0jc0unq1/family1/2656980cd9174509a06d2d79d7a96e26 2023-02-13 21:54:19,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gejldivdq8ri1922cdkl485ersajqpa0brbormovbn3qfv486hrghq5m0jc0unq1/family1/2656980cd9174509a06d2d79d7a96e26 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_ 2023-02-13 21:54:19,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gejldivdq8ri1922cdkl485ersajqpa0brbormovbn3qfv486hrghq5m0jc0unq1/family1/2656980cd9174509a06d2d79d7a96e26 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_ - updating store file list. 2023-02-13 21:54:19,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_ into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:19,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gejldivdq8ri1922cdkl485ersajqpa0brbormovbn3qfv486hrghq5m0jc0unq1/family1/2656980cd9174509a06d2d79d7a96e26 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_) 2023-02-13 21:54:19,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gejldivdq8ri1922cdkl485ersajqpa0brbormovbn3qfv486hrghq5m0jc0unq1/family1/2656980cd9174509a06d2d79d7a96e26 2023-02-13 21:54:19,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:54:19,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:54:19,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 5f04de91d0e8a4ca6aaa34d6a7278404/family1 is initiating minor compaction 2023-02-13 21:54:19,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1df093f4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:19,233 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5f04de91d0e8a4ca6aaa34d6a7278404/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:19,234 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp, totalSize=50.4 K 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 2fcd8f8ca7f14814b61eb4f059c4832e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 50f4df6015674c4cb8bd05c1091b4363, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting a04455b77dac4fd4abf9d3a8aa99d058, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 72ae6c1f4ae7494d98bb3e465836e62b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 3aa256c838d04aaa9abee710ac5e4fb4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting b3b0552de92546e1806bcfd64c23c80b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 7787a21bf76d49218340adffa51611a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting ba05ca1bbb9549a689126f9aa3358a57, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 62560a5221d04f68ab1b04d7b6d9f533, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:54:19,234 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 68402cbc5db74c4db0ef66f2c901b948_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:54:19,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:19,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:19,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a7a254cbd9bd462ca25030f4d4709a66 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a7a254cbd9bd462ca25030f4d4709a66 2023-02-13 21:54:19,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123154263761db7849be8bb15f5238b37219 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123154263761db7849be8bb15f5238b37219 2023-02-13 21:54:19,244 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010187aba71a9670484783b3cd9b540f2d93 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010187aba71a9670484783b3cd9b540f2d93 2023-02-13 21:54:19,245 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c0aa1dad881b44d5a232c12fd0848461 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103c0aa1dad881b44d5a232c12fd0848461 2023-02-13 21:54:19,245 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-13 21:54:19,245 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,339 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5f04de91d0e8a4ca6aaa34d6a7278404#family1#compaction#61 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:19,822 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120525a74e6e39f14bb896b638bfa4652087 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120525a74e6e39f14bb896b638bfa4652087 2023-02-13 21:54:19,826 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/72e5d4006c1e4278aa1629ab26188f2a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72e5d4006c1e4278aa1629ab26188f2a 2023-02-13 21:54:19,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:19,846 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5f04de91d0e8a4ca6aaa34d6a7278404/family1 of 5f04de91d0e8a4ca6aaa34d6a7278404 into 72e5d4006c1e4278aa1629ab26188f2a(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:19,847 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:19,847 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676325259233; duration=0sec 2023-02-13 21:54:19,847 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:19,873 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a65b859d9c194d259b0ab078c6c386e5 first=Optional[r00] last=Optional[r2] 2023-02-13 21:54:19,874 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a65b859d9c194d259b0ab078c6c386e5}] 2023-02-13 21:54:19,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a65b859d9c194d259b0ab078c6c386e5 for inclusion in 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 21:54:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:19,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:19,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a65b859d9c194d259b0ab078c6c386e5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__80e7jnn6d3voaphmbnr28efsaaht4u81ll63t0h81k114orpo8afcabos41e0f9g/family1/a65b859d9c194d259b0ab078c6c386e5 2023-02-13 21:54:19,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__80e7jnn6d3voaphmbnr28efsaaht4u81ll63t0h81k114orpo8afcabos41e0f9g/family1/a65b859d9c194d259b0ab078c6c386e5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_ 2023-02-13 21:54:19,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__80e7jnn6d3voaphmbnr28efsaaht4u81ll63t0h81k114orpo8afcabos41e0f9g/family1/a65b859d9c194d259b0ab078c6c386e5 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_ - updating store file list. 2023-02-13 21:54:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_ into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:19,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__80e7jnn6d3voaphmbnr28efsaaht4u81ll63t0h81k114orpo8afcabos41e0f9g/family1/a65b859d9c194d259b0ab078c6c386e5 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_) 2023-02-13 21:54:19,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__80e7jnn6d3voaphmbnr28efsaaht4u81ll63t0h81k114orpo8afcabos41e0f9g/family1/a65b859d9c194d259b0ab078c6c386e5 2023-02-13 21:54:19,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:54:19,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:54:19,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 5f04de91d0e8a4ca6aaa34d6a7278404/family1 is initiating minor compaction (all files) 2023-02-13 21:54:19,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2032301; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:19,894 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5f04de91d0e8a4ca6aaa34d6a7278404/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:19,894 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72e5d4006c1e4278aa1629ab26188f2a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp, totalSize=390.1 K 2023-02-13 21:54:19,895 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 650a9c756c9e409dafab1b77ab130d5c, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:54:19,895 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 72e5d4006c1e4278aa1629ab26188f2a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:54:19,895 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809985 2023-02-13 21:54:19,902 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:19,903 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:19,905 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f46dd6e718fd4719928ca9eaf204b3b5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130f46dd6e718fd4719928ca9eaf204b3b5 2023-02-13 21:54:19,906 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018189a3e672e040fea558c8e848dcb834 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018189a3e672e040fea558c8e848dcb834 2023-02-13 21:54:19,908 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120504fd96477c5a42e9ab30ab2453f435a8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120504fd96477c5a42e9ab30ab2453f435a8 2023-02-13 21:54:19,908 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-13 21:54:19,908 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 21:54:19,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:19,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:19,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:19,909 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:19,911 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.6160 sec 2023-02-13 21:54:19,915 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5f04de91d0e8a4ca6aaa34d6a7278404#family1#compaction#62 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:19,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_] to archive 2023-02-13 21:54:19,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:19,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/2fcd8f8ca7f14814b61eb4f059c4832e 2023-02-13 21:54:19,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/50f4df6015674c4cb8bd05c1091b4363 2023-02-13 21:54:19,967 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 35 more 2023-02-13 21:54:19,970 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a04455b77dac4fd4abf9d3a8aa99d058 2023-02-13 21:54:19,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72ae6c1f4ae7494d98bb3e465836e62b 2023-02-13 21:54:19,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/3aa256c838d04aaa9abee710ac5e4fb4 2023-02-13 21:54:19,977 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/b3b0552de92546e1806bcfd64c23c80b 2023-02-13 21:54:19,979 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/.tmp/family1/a6ad4ce9c16041cca817179ed528a50e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a6ad4ce9c16041cca817179ed528a50e 2023-02-13 21:54:19,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/7787a21bf76d49218340adffa51611a0 2023-02-13 21:54:19,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/ba05ca1bbb9549a689126f9aa3358a57 2023-02-13 21:54:19,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/62560a5221d04f68ab1b04d7b6d9f533 2023-02-13 21:54:19,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/68402cbc5db74c4db0ef66f2c901b948_SeqId_44_ 2023-02-13 21:54:19,986 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5f04de91d0e8a4ca6aaa34d6a7278404/family1 of 5f04de91d0e8a4ca6aaa34d6a7278404 into a6ad4ce9c16041cca817179ed528a50e(size=193.3 K), total size for store is 193.3 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:19,986 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:19,986 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676325259894; duration=0sec 2023-02-13 21:54:19,987 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:20,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72e5d4006c1e4278aa1629ab26188f2a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_] to archive 2023-02-13 21:54:20,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 21:54:20,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:20,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:20,035 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/650a9c756c9e409dafab1b77ab130d5c 2023-02-13 21:54:20,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72e5d4006c1e4278aa1629ab26188f2a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/72e5d4006c1e4278aa1629ab26188f2a 2023-02-13 21:54:20,037 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/c7c4f5eb379e4ef184c0b7f754205f27_SeqId_47_ 2023-02-13 21:54:20,045 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:20,046 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:20,046 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:20,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 21:54:20,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE}] 2023-02-13 21:54:20,057 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE 2023-02-13 21:54:20,058 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:20,058 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325260058"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325260058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325260058"}]},"ts":"1676325260058"} 2023-02-13 21:54:20,060 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:20,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5f04de91d0e8a4ca6aaa34d6a7278404, disabling compactions & flushes 2023-02-13 21:54:20,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. after waiting 0 ms 2023-02-13 21:54:20,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 21:54:20,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Waiting for close lock at 1676325260214Running coprocessor pre-close hooks at 1676325260214Disabling compacts and flushes for region at 1676325260214Disabling writes for close at 1676325260214Writing region close event to WAL at 1676325260217 (+3 ms)Running coprocessor post-close hooks at 1676325260220 (+3 ms)Closed at 1676325260221 (+1 ms) 2023-02-13 21:54:20,221 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 5f04de91d0e8a4ca6aaa34d6a7278404 to self. 2023-02-13 21:54:20,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,223 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=CLOSED 2023-02-13 21:54:20,223 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325260223"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325260223"}]},"ts":"1676325260223"} 2023-02-13 21:54:20,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-13 21:54:20,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101 in 164 msec 2023-02-13 21:54:20,226 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=true 2023-02-13 21:54:20,376 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:20,376 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325260376"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325260376"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325260376"}]},"ts":"1676325260376"} 2023-02-13 21:54:20,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:20,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f04de91d0e8a4ca6aaa34d6a7278404, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:20,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:20,536 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,539 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,541 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:20,542 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:20,542 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f04de91d0e8a4ca6aaa34d6a7278404 columnFamilyName family1 2023-02-13 21:54:20,552 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a6ad4ce9c16041cca817179ed528a50e 2023-02-13 21:54:20,552 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(310): Store=5f04de91d0e8a4ca6aaa34d6a7278404/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:20,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:20,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5f04de91d0e8a4ca6aaa34d6a7278404; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63824130, jitterRate=-0.04894635081291199}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:20,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Running coprocessor pre-open hook at 1676325260537Writing region info on filesystem at 1676325260537Initializing all the Stores at 1676325260538 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676325260539 (+1 ms)Cleaning up temporary data from old regions at 1676325260556 (+17 ms)Cleaning up detritus from prior splits at 1676325260556Running coprocessor post-open hooks at 1676325260560 (+4 ms)Region opened successfully at 1676325260560 2023-02-13 21:54:20,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., pid=47, masterSystemTime=1676325260530 2023-02-13 21:54:20,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:20,563 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:20,564 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325260563"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325260563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325260563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325260563"}]},"ts":"1676325260563"} 2023-02-13 21:54:20,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-13 21:54:20,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101 in 187 msec 2023-02-13 21:54:20,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-13 21:54:20,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE in 510 msec 2023-02-13 21:54:20,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-13 21:54:20,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 522 msec 2023-02-13 21:54:20,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 543 msec 2023-02-13 21:54:20,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-13 21:54:20,579 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(278): alter status finished 2023-02-13 21:54:20,580 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:20,582 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:20,582 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:20,583 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325860583 2023-02-13 21:54:20,583 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:20,584 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:20,585 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 21:54:20,585 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:20,585 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x5bb83f81 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:20,590 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@113ba65a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:20,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:20,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:20,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:20,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:20,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:21,437 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e2930fd762d545598412ac0bc0cb409c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128e2930fd762d545598412ac0bc0cb409c 2023-02-13 21:54:21,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:21,450 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:21,450 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48994, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:21,456 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:21,458 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57674, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:21,466 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/889f0250920b4fc58ef56d8ef1c55055 first=Optional[r05] last=Optional[r8] 2023-02-13 21:54:21,467 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/889f0250920b4fc58ef56d8ef1c55055}] 2023-02-13 21:54:21,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/889f0250920b4fc58ef56d8ef1c55055 for inclusion in 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:21,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 21:54:21,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:21,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 5f04de91d0e8a4ca6aaa34d6a7278404: 2023-02-13 21:54:21,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/889f0250920b4fc58ef56d8ef1c55055 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rhgaffknneu57i4kpv54ljq9kvkhtv9mlqdqcknr5esi54sccechlkt27qig43ut/family1/889f0250920b4fc58ef56d8ef1c55055 2023-02-13 21:54:21,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rhgaffknneu57i4kpv54ljq9kvkhtv9mlqdqcknr5esi54sccechlkt27qig43ut/family1/889f0250920b4fc58ef56d8ef1c55055 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/82e8c5d3b4b74ee7b66681952f777769_SeqId_53_ 2023-02-13 21:54:21,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rhgaffknneu57i4kpv54ljq9kvkhtv9mlqdqcknr5esi54sccechlkt27qig43ut/family1/889f0250920b4fc58ef56d8ef1c55055 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/82e8c5d3b4b74ee7b66681952f777769_SeqId_53_ - updating store file list. 2023-02-13 21:54:21,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/82e8c5d3b4b74ee7b66681952f777769_SeqId_53_ into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:21,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rhgaffknneu57i4kpv54ljq9kvkhtv9mlqdqcknr5esi54sccechlkt27qig43ut/family1/889f0250920b4fc58ef56d8ef1c55055 into 5f04de91d0e8a4ca6aaa34d6a7278404/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/82e8c5d3b4b74ee7b66681952f777769_SeqId_53_) 2023-02-13 21:54:21,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__rhgaffknneu57i4kpv54ljq9kvkhtv9mlqdqcknr5esi54sccechlkt27qig43ut/family1/889f0250920b4fc58ef56d8ef1c55055 2023-02-13 21:54:21,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:21,487 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:21,488 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208f1e227c073441a2ac0184d0e9207b2d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511208f1e227c073441a2ac0184d0e9207b2d 2023-02-13 21:54:21,488 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128705548efdc654da3b65af1ba4d3a3a6e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128705548efdc654da3b65af1ba4d3a3a6e 2023-02-13 21:54:21,488 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-13 21:54:21,488 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 21:54:21,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:21,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:21,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:21,489 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:21,489 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:21,490 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:21,491 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 909 msec 2023-02-13 21:54:21,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:54:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:21,960 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 21:54:21,961 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:21,961 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-13 21:54:21,963 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-13 21:54:21,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE}] 2023-02-13 21:54:21,966 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE 2023-02-13 21:54:21,967 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:21,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325261967"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325261967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325261967"}]},"ts":"1676325261967"} 2023-02-13 21:54:21,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:22,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5f04de91d0e8a4ca6aaa34d6a7278404, disabling compactions & flushes 2023-02-13 21:54:22,120 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. after waiting 0 ms 2023-02-13 21:54:22,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 21:54:22,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Waiting for close lock at 1676325262120Running coprocessor pre-close hooks at 1676325262120Disabling compacts and flushes for region at 1676325262120Disabling writes for close at 1676325262120Writing region close event to WAL at 1676325262122 (+2 ms)Running coprocessor post-close hooks at 1676325262126 (+4 ms)Closed at 1676325262127 (+1 ms) 2023-02-13 21:54:22,127 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 5f04de91d0e8a4ca6aaa34d6a7278404 to self. 2023-02-13 21:54:22,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=CLOSED 2023-02-13 21:54:22,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325262128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325262128"}]},"ts":"1676325262128"} 2023-02-13 21:54:22,131 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-13 21:54:22,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101 in 162 msec 2023-02-13 21:54:22,132 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=true 2023-02-13 21:54:22,283 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:22,283 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325262282"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325262282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325262282"}]},"ts":"1676325262282"} 2023-02-13 21:54:22,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:22,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f04de91d0e8a4ca6aaa34d6a7278404, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:22,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,441 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,442 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:22,442 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1 2023-02-13 21:54:22,442 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f04de91d0e8a4ca6aaa34d6a7278404 columnFamilyName family1 2023-02-13 21:54:22,447 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/82e8c5d3b4b74ee7b66681952f777769_SeqId_53_ 2023-02-13 21:54:22,452 DEBUG [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/family1/a6ad4ce9c16041cca817179ed528a50e 2023-02-13 21:54:22,452 INFO [StoreOpener-5f04de91d0e8a4ca6aaa34d6a7278404-1] regionserver.HStore(310): Store=5f04de91d0e8a4ca6aaa34d6a7278404/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:22,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:54:22,458 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5f04de91d0e8a4ca6aaa34d6a7278404; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59980860, jitterRate=-0.10621553659439087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:22,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Running coprocessor pre-open hook at 1676325262440Writing region info on filesystem at 1676325262440Initializing all the Stores at 1676325262440Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325262441 (+1 ms)Cleaning up temporary data from old regions at 1676325262455 (+14 ms)Cleaning up detritus from prior splits at 1676325262455Running coprocessor post-open hooks at 1676325262458 (+3 ms)Region opened successfully at 1676325262458 2023-02-13 21:54:22,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404., pid=53, masterSystemTime=1676325262436 2023-02-13 21:54:22,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,460 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:54:22,460 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5f04de91d0e8a4ca6aaa34d6a7278404, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:22,460 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676325262460"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325262460"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325262460"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325262460"}]},"ts":"1676325262460"} 2023-02-13 21:54:22,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-13 21:54:22,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 5f04de91d0e8a4ca6aaa34d6a7278404, server=jenkins-hbase20.apache.org,34815,1676325186101 in 178 msec 2023-02-13 21:54:22,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-13 21:54:22,464 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5f04de91d0e8a4ca6aaa34d6a7278404, REOPEN/MOVE in 497 msec 2023-02-13 21:54:22,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-13 21:54:22,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 502 msec 2023-02-13 21:54:22,467 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 917 msec 2023-02-13 21:54:22,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-13 21:54:22,469 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(278): alter status finished 2023-02-13 21:54:22,470 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-13 21:54:22,471 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:22,472 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:22,473 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325862473 2023-02-13 21:54:22,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:22,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:22,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-13 21:54:22,474 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:22,475 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x4dbf9e06 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:22,479 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1faf89d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,479 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-13 21:54:22,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-13 21:54:22,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:22,481 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-13 21:54:22,482 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-02-13 21:54:22,536 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=241 (was 253), OpenFileDescriptor=610 (was 615), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 248) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=6477 (was 6686) 2023-02-13 21:54:22,547 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=241, OpenFileDescriptor=610, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=165, AvailableMemoryMB=6477 2023-02-13 21:54:22,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-13 21:54:22,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:22,550 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:54:22,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-13 21:54:22,551 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:54:22,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 21:54:22,552 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:22,552 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f empty. 2023-02-13 21:54:22,553 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:22,553 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-13 21:54:22,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 21:54:22,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 21:54:22,960 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:22,961 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8f063bcc9162a76c6ed12c6cf5f8ce2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:22,971 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:22,971 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 8f063bcc9162a76c6ed12c6cf5f8ce2f, disabling compactions & flushes 2023-02-13 21:54:22,972 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:22,972 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:22,972 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. after waiting 0 ms 2023-02-13 21:54:22,972 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:22,972 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:22,972 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Waiting for close lock at 1676325262971Disabling compacts and flushes for region at 1676325262971Disabling writes for close at 1676325262972 (+1 ms)Writing region close event to WAL at 1676325262972Closed at 1676325262972 2023-02-13 21:54:22,974 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:54:22,975 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325262975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325262975"}]},"ts":"1676325262975"} 2023-02-13 21:54:22,976 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:54:22,977 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:54:22,977 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325262977"}]},"ts":"1676325262977"} 2023-02-13 21:54:22,978 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-13 21:54:22,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, ASSIGN}] 2023-02-13 21:54:22,983 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, ASSIGN 2023-02-13 21:54:22,984 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:23,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:23,136 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325263135"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325263135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325263135"}]},"ts":"1676325263135"} 2023-02-13 21:54:23,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:23,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 21:54:23,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f063bcc9162a76c6ed12c6cf5f8ce2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,293 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,295 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:23,295 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:23,295 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f063bcc9162a76c6ed12c6cf5f8ce2f columnFamilyName family1 2023-02-13 21:54:23,297 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(310): Store=8f063bcc9162a76c6ed12c6cf5f8ce2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:23,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:23,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:23,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8f063bcc9162a76c6ed12c6cf5f8ce2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74001759, jitterRate=0.10271213948726654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:23,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Running coprocessor pre-open hook at 1676325263292Writing region info on filesystem at 1676325263292Initializing all the Stores at 1676325263293 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676325263293Cleaning up temporary data from old regions at 1676325263299 (+6 ms)Cleaning up detritus from prior splits at 1676325263299Running coprocessor post-open hooks at 1676325263304 (+5 ms)Region opened successfully at 1676325263304 2023-02-13 21:54:23,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., pid=57, masterSystemTime=1676325263289 2023-02-13 21:54:23,307 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:23,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:23,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:23,308 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325263307"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325263307"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325263307"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325263307"}]},"ts":"1676325263307"} 2023-02-13 21:54:23,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-13 21:54:23,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 172 msec 2023-02-13 21:54:23,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-13 21:54:23,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, ASSIGN in 330 msec 2023-02-13 21:54:23,312 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:54:23,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325263312"}]},"ts":"1676325263312"} 2023-02-13 21:54:23,314 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-13 21:54:23,316 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:54:23,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 767 msec 2023-02-13 21:54:23,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-13 21:54:23,658 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-13 21:54:23,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:23,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,691 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:23,691 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:23,691 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:23,691 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:23,691 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,691 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,692 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:23,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:23,692 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:23,694 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:23,694 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:23,694 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:23,695 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:23,695 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:23,695 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:23,695 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:23,695 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:23,695 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:23,697 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:54:24,123 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113098b3a53dc15e49c38e3765022f6de15e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113098b3a53dc15e49c38e3765022f6de15e 2023-02-13 21:54:24,527 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/93200cc032d6479f9732c45829220f8a 2023-02-13 21:54:24,533 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/93200cc032d6479f9732c45829220f8a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a 2023-02-13 21:54:24,539 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-13 21:54:24,540 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 844ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:24,540 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:24,541 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:24,541 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f5560d1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:24,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:24,544 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,544 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:24,545 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,545 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:24,545 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:24,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:24,547 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:24,547 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:24,547 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:24,547 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,547 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:24,548 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,548 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:24,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,548 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:24,548 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:24,549 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,552 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:24,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:24,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:24,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:24,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,652 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:24,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:24,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,661 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:24,661 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:24,661 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:24,661 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:24,662 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,662 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,663 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:24,663 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:24,663 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:24,663 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:24,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,664 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,664 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:24,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:24,664 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:24,664 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:24,664 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:24,669 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:24,669 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:24,669 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:24,669 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:24,670 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:54:24,693 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284576a36c39414f3783139234a24cdd71 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284576a36c39414f3783139234a24cdd71 2023-02-13 21:54:25,105 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/630c023707e647c4859bdd7237a664ad 2023-02-13 21:54:25,113 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/630c023707e647c4859bdd7237a664ad as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad 2023-02-13 21:54:25,120 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:54:25,121 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 451ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:25,122 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:25,122 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:25,122 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:25,122 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:25,122 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,122 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:25,122 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:25,123 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:25,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:25,124 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,124 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:25,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:25,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:25,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b489ad[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:25,125 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:25,125 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,126 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,127 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,127 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:25,127 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:25,127 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:25,127 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:25,128 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:25,128 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:25,128 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:25,128 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:25,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:25,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:25,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:25,130 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:25,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:25,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:25,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,130 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:25,131 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,131 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,131 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:25,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:25,132 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,133 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,134 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,134 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:25,135 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:25,134 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:25,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:25,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:25,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:25,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:25,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:25,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:25,235 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:25,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:25,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:25,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:25,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,242 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:25,242 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:25,242 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:25,242 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:25,243 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,243 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:25,244 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,244 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:25,244 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:25,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,245 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,245 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:25,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:25,246 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:25,246 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:25,246 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:25,662 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d361c2d2e55f46bebcf8781ffaebe638 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d361c2d2e55f46bebcf8781ffaebe638 2023-02-13 21:54:25,723 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:54:26,112 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/0493b1aa0fd144d2898c7991b79d25ca 2023-02-13 21:54:26,118 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/0493b1aa0fd144d2898c7991b79d25ca as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca 2023-02-13 21:54:26,125 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca, entries=1, sequenceid=13, filesize=5.0 K 2023-02-13 21:54:26,126 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 880ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:26,126 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:26,126 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:26,126 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:26,126 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:26,126 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,126 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:26,126 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:26,127 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,127 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:26,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:26,128 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,128 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:26,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45ccad9[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:26,129 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:26,129 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,130 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,130 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:26,130 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:26,130 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:26,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:26,131 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:26,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:26,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:26,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:26,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:26,134 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:26,134 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:26,134 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:26,134 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,134 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:26,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:26,135 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:26,135 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,138 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:26,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:26,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:26,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:26,138 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:26,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:26,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:26,139 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:26,139 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:26,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:26,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:26,239 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:26,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:26,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:26,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:26,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,245 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:26,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:26,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:26,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:26,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,245 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,246 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:26,246 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:26,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:26,247 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:26,247 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:26,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,248 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:26,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:26,248 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:26,248 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:26,248 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:26,249 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:26,249 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:26,249 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:26,249 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:26,250 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:26,683 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d7a94473dae042e99650f906da3ede2a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d7a94473dae042e99650f906da3ede2a 2023-02-13 21:54:27,088 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/9de105aae1354b218f507045fd8dfc7a 2023-02-13 21:54:27,094 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/9de105aae1354b218f507045fd8dfc7a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a 2023-02-13 21:54:27,100 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a, entries=1, sequenceid=17, filesize=5.0 K 2023-02-13 21:54:27,101 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 851ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:27,101 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:27,101 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:27,101 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:27,101 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:27,101 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,101 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:27,101 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:27,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,104 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:27,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:27,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:27,106 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@731077e1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:27,106 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:27,106 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,107 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:27,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:27,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:27,107 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,107 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:27,108 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:27,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:27,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:27,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:27,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:27,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:27,113 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:27,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:27,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:27,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,113 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:27,114 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:27,114 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,114 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:27,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:27,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:27,116 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:27,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,117 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,119 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,119 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,119 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,119 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:27,119 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:27,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:27,120 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:27,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:27,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:27,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:27,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:27,120 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:27,221 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:27,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:27,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:27,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:27,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,228 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:27,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:27,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:27,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:27,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,228 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,229 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:27,229 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:27,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:27,230 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:27,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,231 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:27,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:27,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:27,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:27,231 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:27,232 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:27,232 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:27,232 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:27,232 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:27,232 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:27,649 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285e6661c071924952b184f2e28ce16355 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285e6661c071924952b184f2e28ce16355 2023-02-13 21:54:28,058 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/b95eddad2c2e4c9a8b59e49df37c3797 2023-02-13 21:54:28,065 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/b95eddad2c2e4c9a8b59e49df37c3797 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797 2023-02-13 21:54:28,071 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 21:54:28,072 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 840ms, sequenceid=21, compaction requested=true 2023-02-13 21:54:28,072 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:28,072 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:28,072 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:28,072 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:28,072 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,072 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:28,072 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:28,073 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,073 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:28,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:28,074 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,074 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57e7d2ba[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:28,075 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:28,075 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,075 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:28,076 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,076 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:28,076 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:28,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:28,076 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:28,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:28,078 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:28,078 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:28,078 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:28,078 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,078 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:28,079 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,079 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:28,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:28,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,079 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,080 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:28,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:28,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,080 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:28,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:28,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:28,082 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:28,082 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:28,183 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:28,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:28,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:28,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,191 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:28,191 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:28,191 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:28,191 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:28,191 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,191 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,192 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:28,192 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:28,193 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:28,193 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,194 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,194 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:28,194 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:28,195 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:28,195 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:28,195 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:28,195 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:28,614 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231eb4acad457114552a49af5bad4cafa60 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb4acad457114552a49af5bad4cafa60 2023-02-13 21:54:29,022 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/2ecd1be3ccb24d54bd64a228f1b856a3 2023-02-13 21:54:29,033 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/2ecd1be3ccb24d54bd64a228f1b856a3 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3 2023-02-13 21:54:29,038 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3, entries=1, sequenceid=25, filesize=5.0 K 2023-02-13 21:54:29,039 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 844ms, sequenceid=25, compaction requested=true 2023-02-13 21:54:29,039 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:29,039 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:29,039 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:29,039 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:29,039 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,039 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:29,039 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:29,040 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,040 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:29,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23eac00a[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:29,042 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:29,042 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,043 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,043 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:29,043 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:29,043 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:29,043 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,043 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:29,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:29,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:29,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:29,046 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:29,046 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:29,046 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:29,046 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,046 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:29,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,051 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,052 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:29,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,053 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:29,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:29,053 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,054 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:29,054 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:29,054 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:29,054 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,154 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:29,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:29,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:29,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:29,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,160 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:29,160 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:29,160 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:29,160 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:29,161 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,161 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,161 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,161 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:29,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:29,162 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,162 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,163 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:29,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,163 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:29,163 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:29,163 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:29,163 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:29,163 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:29,163 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:29,163 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:29,163 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:29,580 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013cfa787bc88c4f85a172339aebd43a1f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013cfa787bc88c4f85a172339aebd43a1f 2023-02-13 21:54:29,586 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/f5cf34571792431bb300524700354bb5 2023-02-13 21:54:29,591 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/f5cf34571792431bb300524700354bb5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5 2023-02-13 21:54:29,595 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5, entries=1, sequenceid=29, filesize=5.0 K 2023-02-13 21:54:29,596 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 433ms, sequenceid=29, compaction requested=true 2023-02-13 21:54:29,596 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:29,596 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:29,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:29,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:29,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,596 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:29,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:29,597 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,597 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,598 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,598 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:29,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4182dcac[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:29,599 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:29,599 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,599 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:29,600 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,600 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:29,600 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:29,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,600 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:29,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:29,602 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:29,602 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:29,602 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:29,602 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,602 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:29,603 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,603 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:29,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,603 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:29,604 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:29,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,605 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:29,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:29,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:29,606 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:29,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:29,606 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:29,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:29,607 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:29,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:29,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:29,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:29,607 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:29,707 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:29,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:29,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:29,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:29,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,712 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:29,712 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:29,713 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:29,713 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:29,713 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,713 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,714 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:29,714 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:29,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:29,714 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:29,714 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:29,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:29,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,715 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,715 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:29,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:29,715 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:29,715 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:29,715 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:29,715 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:29,715 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:29,715 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:29,715 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:29,716 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:30,129 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038ffc6212e2ec4d87b0c1a9315370c381 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffc6212e2ec4d87b0c1a9315370c381 2023-02-13 21:54:30,537 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/38c7cdebf2904cf28ba72e761b623fc2 2023-02-13 21:54:30,542 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/38c7cdebf2904cf28ba72e761b623fc2 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2 2023-02-13 21:54:30,547 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2, entries=1, sequenceid=33, filesize=5.0 K 2023-02-13 21:54:30,548 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 832ms, sequenceid=33, compaction requested=true 2023-02-13 21:54:30,548 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:30,548 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:30,548 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:30,549 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,549 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:30,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:30,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:30,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:30,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@315d1402[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:30,551 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:30,551 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:30,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:30,552 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,552 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:30,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:30,553 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,553 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:30,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:30,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:30,555 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:30,555 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:30,555 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:30,555 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,555 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:30,556 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,556 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,556 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:30,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:30,556 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:30,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,561 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:30,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:30,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:30,561 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:30,562 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:30,562 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,562 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,662 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:30,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:30,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:30,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:30,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,668 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:30,668 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:30,668 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:30,668 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:30,668 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,668 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,669 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:30,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:30,669 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:30,670 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:30,670 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:30,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,670 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:30,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,670 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:30,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:30,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:30,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:30,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:30,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:30,671 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:30,671 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:30,671 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:30,672 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:31,083 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907358ec8f262c24ccd8d58e7892bdce998 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907358ec8f262c24ccd8d58e7892bdce998 2023-02-13 21:54:31,489 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/d70e986a787f4399a95adab6643b3126 2023-02-13 21:54:31,494 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/d70e986a787f4399a95adab6643b3126 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126 2023-02-13 21:54:31,500 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126, entries=1, sequenceid=37, filesize=5.0 K 2023-02-13 21:54:31,501 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 829ms, sequenceid=37, compaction requested=true 2023-02-13 21:54:31,501 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:31,501 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:31,501 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:31,501 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:31,501 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,501 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:31,501 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:31,503 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,503 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:31,503 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,503 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:31,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:31,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:31,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58467291[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:31,505 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:31,505 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,505 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,505 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:31,505 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:31,506 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:31,506 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,506 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:31,506 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,506 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:31,506 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:31,507 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:31,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:31,509 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:31,509 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:31,509 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:31,509 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,509 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:31,510 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,510 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:31,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,510 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:31,510 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:31,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,511 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:31,512 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:31,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:31,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:31,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:31,512 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:31,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-13 21:54:31,513 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,513 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,513 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:31,513 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:31,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:31,613 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:31,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:31,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,625 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:31,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:31,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-13 21:54:31,625 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-13 21:54:31,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,626 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,645 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:31,645 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:31,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:31,646 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:31,646 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:31,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,646 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-13 21:54:31,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:31,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-13 21:54:31,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:31,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-13 21:54:31,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:54:31,647 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:31,647 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:31,647 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. started... 2023-02-13 21:54:31,647 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f063bcc9162a76c6ed12c6cf5f8ce2f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:54:31,676 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112044f43062df074359b7fc98eb1f179663 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112044f43062df074359b7fc98eb1f179663 2023-02-13 21:54:32,090 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/b94cce3694924461863242af384edce5 2023-02-13 21:54:32,098 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/b94cce3694924461863242af384edce5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5 2023-02-13 21:54:32,103 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5, entries=1, sequenceid=41, filesize=5.0 K 2023-02-13 21:54:32,104 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f063bcc9162a76c6ed12c6cf5f8ce2f in 457ms, sequenceid=41, compaction requested=true 2023-02-13 21:54:32,105 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:32,105 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:32,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:54:32,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:54:32,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-13 21:54:32,105 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-13 21:54:32,106 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,106 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:32,106 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,106 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-13 21:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d591303[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:32,107 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-13 21:54:32,107 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,108 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-13 21:54:32,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-13 21:54:32,108 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,108 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:32,108 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:32,109 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-13 21:54:32,109 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,109 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:32,109 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-13 21:54:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-13 21:54:32,111 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-13 21:54:32,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:32,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:32,111 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,111 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:32,112 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,112 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:32,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,112 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:32,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:32,113 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:32,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,114 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,115 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,115 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,115 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:32,115 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:32,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:32,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:32,115 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:32,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-13 21:54:32,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:32,115 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:32,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:32,116 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:32,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:32,216 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:32,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:32,219 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:32,221 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:32,222 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:32,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:32,223 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325872223 2023-02-13 21:54:32,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:32,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 21:54:32,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:32,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x36524ed6 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:32,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f77811, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:32,230 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,701 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f503e55467fc480bb78faf48fadbe9e7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103f503e55467fc480bb78faf48fadbe9e7 2023-02-13 21:54:32,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:32,717 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:32,718 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:32,725 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:32,726 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:32,740 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/86207e06590541cca60c871d1f4e4e8b first=Optional[r3] last=Optional[r6] 2023-02-13 21:54:32,740 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/86207e06590541cca60c871d1f4e4e8b}] 2023-02-13 21:54:32,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/86207e06590541cca60c871d1f4e4e8b for inclusion in 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-13 21:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:32,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/86207e06590541cca60c871d1f4e4e8b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rgu1s6j0bp10cuhveum5c388gbsiftbjji0prptngu837vqivektc77fn91p3iqg/family1/86207e06590541cca60c871d1f4e4e8b 2023-02-13 21:54:32,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rgu1s6j0bp10cuhveum5c388gbsiftbjji0prptngu837vqivektc77fn91p3iqg/family1/86207e06590541cca60c871d1f4e4e8b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_ 2023-02-13 21:54:32,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rgu1s6j0bp10cuhveum5c388gbsiftbjji0prptngu837vqivektc77fn91p3iqg/family1/86207e06590541cca60c871d1f4e4e8b into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_ - updating store file list. 2023-02-13 21:54:32,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_ into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:32,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rgu1s6j0bp10cuhveum5c388gbsiftbjji0prptngu837vqivektc77fn91p3iqg/family1/86207e06590541cca60c871d1f4e4e8b into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_) 2023-02-13 21:54:32,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__rgu1s6j0bp10cuhveum5c388gbsiftbjji0prptngu837vqivektc77fn91p3iqg/family1/86207e06590541cca60c871d1f4e4e8b 2023-02-13 21:54:32,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:54:32,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:54:32,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 is initiating minor compaction 2023-02-13 21:54:32,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@718ada53; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:32,758 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:32,758 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp, totalSize=50.3 K 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 630c023707e647c4859bdd7237a664ad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 0493b1aa0fd144d2898c7991b79d25ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 9de105aae1354b218f507045fd8dfc7a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting b95eddad2c2e4c9a8b59e49df37c3797, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 2ecd1be3ccb24d54bd64a228f1b856a3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting f5cf34571792431bb300524700354bb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 38c7cdebf2904cf28ba72e761b623fc2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d70e986a787f4399a95adab6643b3126, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting b94cce3694924461863242af384edce5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:54:32,759 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:54:32,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:32,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:32,778 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285e6661c071924952b184f2e28ce16355 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285e6661c071924952b184f2e28ce16355 2023-02-13 21:54:32,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb4acad457114552a49af5bad4cafa60 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231eb4acad457114552a49af5bad4cafa60 2023-02-13 21:54:32,790 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013cfa787bc88c4f85a172339aebd43a1f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601013cfa787bc88c4f85a172339aebd43a1f 2023-02-13 21:54:32,796 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffc6212e2ec4d87b0c1a9315370c381 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601038ffc6212e2ec4d87b0c1a9315370c381 2023-02-13 21:54:32,796 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-13 21:54:32,796 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,798 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:32,833 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8f063bcc9162a76c6ed12c6cf5f8ce2f#family1#compaction#73 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:33,651 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/ab9f55f77e194d3b94fd92d6247cd460 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/ab9f55f77e194d3b94fd92d6247cd460 2023-02-13 21:54:33,655 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 of 8f063bcc9162a76c6ed12c6cf5f8ce2f into ab9f55f77e194d3b94fd92d6247cd460(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:33,655 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:33,655 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676325272758; duration=0sec 2023-02-13 21:54:33,656 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:33,661 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cbb725c7e55e43bf9376941d820f6489 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cbb725c7e55e43bf9376941d820f6489 2023-02-13 21:54:33,662 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:33,687 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/572e64c2c7b94324b3ab62ea8f1f2690 first=Optional[r00] last=Optional[r2] 2023-02-13 21:54:33,688 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/572e64c2c7b94324b3ab62ea8f1f2690}] 2023-02-13 21:54:33,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/572e64c2c7b94324b3ab62ea8f1f2690 for inclusion in 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-13 21:54:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:33,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:33,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/572e64c2c7b94324b3ab62ea8f1f2690 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ucs9spb7j9cn8fifcaj3b8iaelb7ps8oqjveird70tiaobddb50ktlggbj86jg7p/family1/572e64c2c7b94324b3ab62ea8f1f2690 2023-02-13 21:54:33,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ucs9spb7j9cn8fifcaj3b8iaelb7ps8oqjveird70tiaobddb50ktlggbj86jg7p/family1/572e64c2c7b94324b3ab62ea8f1f2690 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_ 2023-02-13 21:54:33,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ucs9spb7j9cn8fifcaj3b8iaelb7ps8oqjveird70tiaobddb50ktlggbj86jg7p/family1/572e64c2c7b94324b3ab62ea8f1f2690 into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_ - updating store file list. 2023-02-13 21:54:33,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_ into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:33,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ucs9spb7j9cn8fifcaj3b8iaelb7ps8oqjveird70tiaobddb50ktlggbj86jg7p/family1/572e64c2c7b94324b3ab62ea8f1f2690 into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_) 2023-02-13 21:54:33,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ucs9spb7j9cn8fifcaj3b8iaelb7ps8oqjveird70tiaobddb50ktlggbj86jg7p/family1/572e64c2c7b94324b3ab62ea8f1f2690 2023-02-13 21:54:33,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:54:33,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:54:33,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 is initiating minor compaction (all files) 2023-02-13 21:54:33,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4920a027; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:33,711 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:33,711 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/ab9f55f77e194d3b94fd92d6247cd460, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp, totalSize=388.1 K 2023-02-13 21:54:33,711 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 93200cc032d6479f9732c45829220f8a, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:54:33,713 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting ab9f55f77e194d3b94fd92d6247cd460, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:54:33,714 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:33,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:33,714 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 528f3f6e7eb5447e85405cf224d12adb_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878809985 2023-02-13 21:54:33,717 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113098b3a53dc15e49c38e3765022f6de15e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113098b3a53dc15e49c38e3765022f6de15e 2023-02-13 21:54:33,718 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d361c2d2e55f46bebcf8781ffaebe638 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d361c2d2e55f46bebcf8781ffaebe638 2023-02-13 21:54:33,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d7a94473dae042e99650f906da3ede2a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205d7a94473dae042e99650f906da3ede2a 2023-02-13 21:54:33,719 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-13 21:54:33,719 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-13 21:54:33,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:33,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:33,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:33,721 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:33,722 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.5010 sec 2023-02-13 21:54:33,731 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8f063bcc9162a76c6ed12c6cf5f8ce2f#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:33,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_] to archive 2023-02-13 21:54:33,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:33,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/630c023707e647c4859bdd7237a664ad 2023-02-13 21:54:33,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/0493b1aa0fd144d2898c7991b79d25ca 2023-02-13 21:54:33,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/9de105aae1354b218f507045fd8dfc7a 2023-02-13 21:54:33,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b95eddad2c2e4c9a8b59e49df37c3797 2023-02-13 21:54:33,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2ecd1be3ccb24d54bd64a228f1b856a3 2023-02-13 21:54:33,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/f5cf34571792431bb300524700354bb5 2023-02-13 21:54:33,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/38c7cdebf2904cf28ba72e761b623fc2 2023-02-13 21:54:33,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/d70e986a787f4399a95adab6643b3126 2023-02-13 21:54:33,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/b94cce3694924461863242af384edce5 2023-02-13 21:54:33,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/2f07645d235b4e63bc5df864eadc0ac4_SeqId_44_ 2023-02-13 21:54:33,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 21:54:33,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:34,218 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:34,219 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:34,220 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:34,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 21:54:34,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE}] 2023-02-13 21:54:34,225 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE 2023-02-13 21:54:34,226 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:34,226 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325274226"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325274226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325274226"}]},"ts":"1676325274226"} 2023-02-13 21:54:34,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:34,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8f063bcc9162a76c6ed12c6cf5f8ce2f, disabling compactions & flushes 2023-02-13 21:54:34,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,556 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/.tmp/family1/11b3582fedbb47caaf9395e9c184924d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/11b3582fedbb47caaf9395e9c184924d 2023-02-13 21:54:34,561 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 of 8f063bcc9162a76c6ed12c6cf5f8ce2f into 11b3582fedbb47caaf9395e9c184924d(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:34,561 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:34,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,561 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676325273710; duration=0sec 2023-02-13 21:54:34,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. after waiting 0 ms 2023-02-13 21:54:34,561 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:34,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,564 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/ab9f55f77e194d3b94fd92d6247cd460, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_] to archive 2023-02-13 21:54:34,565 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:34,566 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/93200cc032d6479f9732c45829220f8a 2023-02-13 21:54:34,568 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/ab9f55f77e194d3b94fd92d6247cd460 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/ab9f55f77e194d3b94fd92d6247cd460 2023-02-13 21:54:34,569 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/528f3f6e7eb5447e85405cf224d12adb_SeqId_47_ 2023-02-13 21:54:34,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 21:54:34,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Waiting for close lock at 1676325274380Running coprocessor pre-close hooks at 1676325274380Disabling compacts and flushes for region at 1676325274380Disabling writes for close at 1676325274561 (+181 ms)Writing region close event to WAL at 1676325274571 (+10 ms)Running coprocessor post-close hooks at 1676325274574 (+3 ms)Closed at 1676325274575 (+1 ms) 2023-02-13 21:54:34,575 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8f063bcc9162a76c6ed12c6cf5f8ce2f to self. 2023-02-13 21:54:34,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,576 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=CLOSED 2023-02-13 21:54:34,576 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325274576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325274576"}]},"ts":"1676325274576"} 2023-02-13 21:54:34,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-13 21:54:34,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 350 msec 2023-02-13 21:54:34,579 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=true 2023-02-13 21:54:34,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:34,730 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325274729"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325274729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325274729"}]},"ts":"1676325274729"} 2023-02-13 21:54:34,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:34,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f063bcc9162a76c6ed12c6cf5f8ce2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:34,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:34,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,890 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,892 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:34,892 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:34,892 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f063bcc9162a76c6ed12c6cf5f8ce2f columnFamilyName family1 2023-02-13 21:54:34,901 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/11b3582fedbb47caaf9395e9c184924d 2023-02-13 21:54:34,901 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(310): Store=8f063bcc9162a76c6ed12c6cf5f8ce2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:34,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:34,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8f063bcc9162a76c6ed12c6cf5f8ce2f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61548898, jitterRate=-0.08284994959831238}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:34,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Running coprocessor pre-open hook at 1676325274889Writing region info on filesystem at 1676325274889Initializing all the Stores at 1676325274890 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676325274890Cleaning up temporary data from old regions at 1676325274905 (+15 ms)Cleaning up detritus from prior splits at 1676325274906 (+1 ms)Running coprocessor post-open hooks at 1676325274909 (+3 ms)Region opened successfully at 1676325274909 2023-02-13 21:54:34,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., pid=63, masterSystemTime=1676325274885 2023-02-13 21:54:34,912 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:34,912 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325274912"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325274912"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325274912"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325274912"}]},"ts":"1676325274912"} 2023-02-13 21:54:34,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-13 21:54:34,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 182 msec 2023-02-13 21:54:34,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:34,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-13 21:54:34,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE in 691 msec 2023-02-13 21:54:34,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-13 21:54:34,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 695 msec 2023-02-13 21:54:34,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1090 sec 2023-02-13 21:54:34,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-13 21:54:34,921 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(278): alter status finished 2023-02-13 21:54:34,921 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:34,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:34,923 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:34,924 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325874924 2023-02-13 21:54:34,924 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:34,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:34,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 21:54:34,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:34,926 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x63937d11 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:34,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e7dbcf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:34,931 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:34,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:34,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:34,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:34,932 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:35,374 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288973f98709d04f2eafe7b1da15111e3b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511288973f98709d04f2eafe7b1da15111e3b 2023-02-13 21:54:35,375 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:35,390 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:35,391 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:35,396 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:35,399 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:35,407 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa94e83a5d264d06939ccd3988901fb9 first=Optional[r05] last=Optional[r8] 2023-02-13 21:54:35,408 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa94e83a5d264d06939ccd3988901fb9}] 2023-02-13 21:54:35,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa94e83a5d264d06939ccd3988901fb9 for inclusion in 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:35,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-13 21:54:35,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:35,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: 2023-02-13 21:54:35,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/aa94e83a5d264d06939ccd3988901fb9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gk5jli1odl74egt89hckt0hoc38430i38ont4et2vac8nn1h99g5rph80vr464n/family1/aa94e83a5d264d06939ccd3988901fb9 2023-02-13 21:54:35,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gk5jli1odl74egt89hckt0hoc38430i38ont4et2vac8nn1h99g5rph80vr464n/family1/aa94e83a5d264d06939ccd3988901fb9 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/3cce403f976e440c8b21c5a14c889f49_SeqId_53_ 2023-02-13 21:54:35,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gk5jli1odl74egt89hckt0hoc38430i38ont4et2vac8nn1h99g5rph80vr464n/family1/aa94e83a5d264d06939ccd3988901fb9 into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/3cce403f976e440c8b21c5a14c889f49_SeqId_53_ - updating store file list. 2023-02-13 21:54:35,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/3cce403f976e440c8b21c5a14c889f49_SeqId_53_ into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:35,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gk5jli1odl74egt89hckt0hoc38430i38ont4et2vac8nn1h99g5rph80vr464n/family1/aa94e83a5d264d06939ccd3988901fb9 into 8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/3cce403f976e440c8b21c5a14c889f49_SeqId_53_) 2023-02-13 21:54:35,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gk5jli1odl74egt89hckt0hoc38430i38ont4et2vac8nn1h99g5rph80vr464n/family1/aa94e83a5d264d06939ccd3988901fb9 2023-02-13 21:54:35,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:35,426 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:35,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112044f43062df074359b7fc98eb1f179663 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112044f43062df074359b7fc98eb1f179663 2023-02-13 21:54:35,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284576a36c39414f3783139234a24cdd71 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284576a36c39414f3783139234a24cdd71 2023-02-13 21:54:35,428 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-13 21:54:35,428 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 21:54:35,428 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:35,428 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:35,428 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:35,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:35,428 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:35,429 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:35,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 507 msec 2023-02-13 21:54:35,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-13 21:54:35,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:35,892 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 21:54:35,895 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-13 21:54:35,895 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-13 21:54:35,899 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-13 21:54:35,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE}] 2023-02-13 21:54:35,901 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE 2023-02-13 21:54:35,901 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:35,901 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325275901"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325275901"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325275901"}]},"ts":"1676325275901"} 2023-02-13 21:54:35,902 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:36,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8f063bcc9162a76c6ed12c6cf5f8ce2f, disabling compactions & flushes 2023-02-13 21:54:36,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. after waiting 0 ms 2023-02-13 21:54:36,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 21:54:36,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Waiting for close lock at 1676325276054Running coprocessor pre-close hooks at 1676325276054Disabling compacts and flushes for region at 1676325276054Disabling writes for close at 1676325276055 (+1 ms)Writing region close event to WAL at 1676325276060 (+5 ms)Running coprocessor post-close hooks at 1676325276065 (+5 ms)Closed at 1676325276065 2023-02-13 21:54:36,066 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8f063bcc9162a76c6ed12c6cf5f8ce2f to self. 2023-02-13 21:54:36,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,068 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=CLOSED 2023-02-13 21:54:36,068 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325276068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325276068"}]},"ts":"1676325276068"} 2023-02-13 21:54:36,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-13 21:54:36,072 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 168 msec 2023-02-13 21:54:36,073 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=true 2023-02-13 21:54:36,223 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:36,224 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325276223"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325276223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325276223"}]},"ts":"1676325276223"} 2023-02-13 21:54:36,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:36,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f063bcc9162a76c6ed12c6cf5f8ce2f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,386 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,387 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:36,387 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1 2023-02-13 21:54:36,387 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f063bcc9162a76c6ed12c6cf5f8ce2f columnFamilyName family1 2023-02-13 21:54:36,396 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/11b3582fedbb47caaf9395e9c184924d 2023-02-13 21:54:36,402 DEBUG [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/family1/3cce403f976e440c8b21c5a14c889f49_SeqId_53_ 2023-02-13 21:54:36,402 INFO [StoreOpener-8f063bcc9162a76c6ed12c6cf5f8ce2f-1] regionserver.HStore(310): Store=8f063bcc9162a76c6ed12c6cf5f8ce2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:36,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:54:36,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 8f063bcc9162a76c6ed12c6cf5f8ce2f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73323174, jitterRate=0.09260043501853943}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:36,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Running coprocessor pre-open hook at 1676325276385Writing region info on filesystem at 1676325276385Initializing all the Stores at 1676325276385Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676325276386 (+1 ms)Cleaning up temporary data from old regions at 1676325276405 (+19 ms)Cleaning up detritus from prior splits at 1676325276406 (+1 ms)Running coprocessor post-open hooks at 1676325276409 (+3 ms)Region opened successfully at 1676325276409 2023-02-13 21:54:36,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f., pid=69, masterSystemTime=1676325276381 2023-02-13 21:54:36,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:54:36,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=8f063bcc9162a76c6ed12c6cf5f8ce2f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:36,412 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676325276412"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325276412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325276412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325276412"}]},"ts":"1676325276412"} 2023-02-13 21:54:36,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-13 21:54:36,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 8f063bcc9162a76c6ed12c6cf5f8ce2f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 186 msec 2023-02-13 21:54:36,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-13 21:54:36,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=8f063bcc9162a76c6ed12c6cf5f8ce2f, REOPEN/MOVE in 515 msec 2023-02-13 21:54:36,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-13 21:54:36,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 519 msec 2023-02-13 21:54:36,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 941 msec 2023-02-13 21:54:36,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-13 21:54:36,425 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(278): alter status finished 2023-02-13 21:54:36,427 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-13 21:54:36,428 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:36,429 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:36,430 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325876430 2023-02-13 21:54:36,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:36,430 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:54:36,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-13 21:54:36,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:36,432 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x06a5255c to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:36,437 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f2b035, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-13 21:54:36,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-13 21:54:36,438 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:36,439 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-13 21:54:36,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 12 msec 2023-02-13 21:54:36,496 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=253 (was 241) - Thread LEAK? -, OpenFileDescriptor=643 (was 610) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=299 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=6365 (was 6477) 2023-02-13 21:54:36,506 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=253, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=299, ProcessCount=165, AvailableMemoryMB=6365 2023-02-13 21:54:36,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 21:54:36,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:36,510 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:54:36,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-13 21:54:36,511 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:54:36,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 21:54:36,512 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:36,512 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 empty. 2023-02-13 21:54:36,513 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:36,513 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 21:54:36,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 21:54:36,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 21:54:36,923 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:36,924 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1d40a2b23a83649a9e9748cfa62633a1, NAME => 'testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 1d40a2b23a83649a9e9748cfa62633a1, disabling compactions & flushes 2023-02-13 21:54:36,931 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. after waiting 0 ms 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:36,931 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:36,931 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 1d40a2b23a83649a9e9748cfa62633a1: Waiting for close lock at 1676325276931Disabling compacts and flushes for region at 1676325276931Disabling writes for close at 1676325276931Writing region close event to WAL at 1676325276931Closed at 1676325276931 2023-02-13 21:54:36,933 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:54:36,934 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676325276934"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325276934"}]},"ts":"1676325276934"} 2023-02-13 21:54:36,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:54:36,935 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:54:36,935 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325276935"}]},"ts":"1676325276935"} 2023-02-13 21:54:36,936 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-13 21:54:36,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, ASSIGN}] 2023-02-13 21:54:36,939 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, ASSIGN 2023-02-13 21:54:36,939 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:37,091 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1d40a2b23a83649a9e9748cfa62633a1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:37,091 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676325277091"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325277091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325277091"}]},"ts":"1676325277091"} 2023-02-13 21:54:37,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 1d40a2b23a83649a9e9748cfa62633a1, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:37,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 21:54:37,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:37,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d40a2b23a83649a9e9748cfa62633a1, NAME => 'testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:54:37,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-13 21:54:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-13 21:54:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,259 INFO [StoreOpener-1d40a2b23a83649a9e9748cfa62633a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,261 DEBUG [StoreOpener-1d40a2b23a83649a9e9748cfa62633a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1 2023-02-13 21:54:37,261 DEBUG [StoreOpener-1d40a2b23a83649a9e9748cfa62633a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1 2023-02-13 21:54:37,261 INFO [StoreOpener-1d40a2b23a83649a9e9748cfa62633a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d40a2b23a83649a9e9748cfa62633a1 columnFamilyName f1 2023-02-13 21:54:37,263 INFO [StoreOpener-1d40a2b23a83649a9e9748cfa62633a1-1] regionserver.HStore(310): Store=1d40a2b23a83649a9e9748cfa62633a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:37,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:37,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:37,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1d40a2b23a83649a9e9748cfa62633a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62905745, jitterRate=-0.06263135373592377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:54:37,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1d40a2b23a83649a9e9748cfa62633a1: Running coprocessor pre-open hook at 1676325277257Writing region info on filesystem at 1676325277257Initializing all the Stores at 1676325277258 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325277258Cleaning up temporary data from old regions at 1676325277266 (+8 ms)Cleaning up detritus from prior splits at 1676325277267 (+1 ms)Running coprocessor post-open hooks at 1676325277277 (+10 ms)Region opened successfully at 1676325277277 2023-02-13 21:54:37,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1., pid=73, masterSystemTime=1676325277246 2023-02-13 21:54:37,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:37,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:37,279 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1d40a2b23a83649a9e9748cfa62633a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:37,279 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676325277279"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325277279"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325277279"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325277279"}]},"ts":"1676325277279"} 2023-02-13 21:54:37,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-13 21:54:37,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 1d40a2b23a83649a9e9748cfa62633a1, server=jenkins-hbase20.apache.org,34815,1676325186101 in 187 msec 2023-02-13 21:54:37,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-13 21:54:37,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, ASSIGN in 345 msec 2023-02-13 21:54:37,283 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:54:37,284 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325277283"}]},"ts":"1676325277283"} 2023-02-13 21:54:37,284 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-13 21:54:37,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:54:37,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 778 msec 2023-02-13 21:54:37,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-13 21:54:37,616 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-13 21:54:37,616 DEBUG [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-13 21:54:37,618 INFO [Listener at localhost.localdomain/39503] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 21:54:37,621 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-13 21:54:37,621 INFO [Listener at localhost.localdomain/39503] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 21:54:37,621 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-13 21:54:37,625 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2744): Flushing 1d40a2b23a83649a9e9748cfa62633a1 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 21:54:38,042 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302132f4294f91e374c1bb8ca23322462e066 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302132f4294f91e374c1bb8ca23322462e066 2023-02-13 21:54:38,161 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-13 21:54:38,448 INFO [Listener at localhost.localdomain/39503] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp/f1/a01f1d952afd4a2c9bbbc38200cb4699 2023-02-13 21:54:38,453 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp/f1/a01f1d952afd4a2c9bbbc38200cb4699 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699 2023-02-13 21:54:38,457 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699, entries=1, sequenceid=5, filesize=4.9 K 2023-02-13 21:54:38,458 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1d40a2b23a83649a9e9748cfa62633a1 in 833ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:38,459 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2445): Flush status journal for 1d40a2b23a83649a9e9748cfa62633a1: 2023-02-13 21:54:38,461 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2744): Flushing 1d40a2b23a83649a9e9748cfa62633a1 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-13 21:54:38,879 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302137733e1af0d924d0fb239a6bc13a5cfbb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302137733e1af0d924d0fb239a6bc13a5cfbb 2023-02-13 21:54:39,284 INFO [Listener at localhost.localdomain/39503] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp/f1/487630a1806e413c84daabdbb34082a6 2023-02-13 21:54:39,289 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp/f1/487630a1806e413c84daabdbb34082a6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6 2023-02-13 21:54:39,293 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6, entries=1, sequenceid=9, filesize=4.9 K 2023-02-13 21:54:39,294 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 1d40a2b23a83649a9e9748cfa62633a1 in 833ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:39,294 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2445): Flush status journal for 1d40a2b23a83649a9e9748cfa62633a1: 2023-02-13 21:54:39,295 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-13 21:54:39,297 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 21:54:39,298 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 21:54:39,298 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:39,298 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325879298 2023-02-13 21:54:39,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:54:39,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-13 21:54:39,299 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-13 21:54:39,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x66d32de9 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:39,303 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74b25a1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:39,304 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 21:54:39,349 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,349 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,400 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,400 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,451 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,451 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,502 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,502 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,553 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,553 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,604 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,604 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,655 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,655 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,706 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,706 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,757 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,757 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,808 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,808 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,859 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,859 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,910 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,910 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,961 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:39,961 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,012 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,012 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,063 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,064 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,113 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:54:40,115 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,115 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,134 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021314eaee048b214c4baddd27ef15589c51 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021314eaee048b214c4baddd27ef15589c51 2023-02-13 21:54:40,134 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 21:54:40,149 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:40,149 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45952, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:40,168 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,168 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,184 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:54:40,186 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33864, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:54:40,214 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/cec84944cc624611b52e5b33b7d4c9d4 first=Optional[r1] last=Optional[r2] 2023-02-13 21:54:40,215 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/cec84944cc624611b52e5b33b7d4c9d4}] 2023-02-13 21:54:40,220 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,220 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/cec84944cc624611b52e5b33b7d4c9d4 for inclusion in 1d40a2b23a83649a9e9748cfa62633a1/f1 2023-02-13 21:54:40,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-13 21:54:40,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:54:40,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 1d40a2b23a83649a9e9748cfa62633a1: 2023-02-13 21:54:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/f1/cec84944cc624611b52e5b33b7d4c9d4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testGetAfterCompaction__vt6fbf5kmaudt6i3h8c8s4pq8jc261of2k9b9psjiea0a6tb713ljk18iltbonu3/f1/cec84944cc624611b52e5b33b7d4c9d4 2023-02-13 21:54:40,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testGetAfterCompaction__vt6fbf5kmaudt6i3h8c8s4pq8jc261of2k9b9psjiea0a6tb713ljk18iltbonu3/f1/cec84944cc624611b52e5b33b7d4c9d4 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_ 2023-02-13 21:54:40,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testGetAfterCompaction__vt6fbf5kmaudt6i3h8c8s4pq8jc261of2k9b9psjiea0a6tb713ljk18iltbonu3/f1/cec84944cc624611b52e5b33b7d4c9d4 into 1d40a2b23a83649a9e9748cfa62633a1/f1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_ - updating store file list. 2023-02-13 21:54:40,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_ into 1d40a2b23a83649a9e9748cfa62633a1/f1 2023-02-13 21:54:40,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testGetAfterCompaction__vt6fbf5kmaudt6i3h8c8s4pq8jc261of2k9b9psjiea0a6tb713ljk18iltbonu3/f1/cec84944cc624611b52e5b33b7d4c9d4 into 1d40a2b23a83649a9e9748cfa62633a1/f1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_) 2023-02-13 21:54:40,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testGetAfterCompaction__vt6fbf5kmaudt6i3h8c8s4pq8jc261of2k9b9psjiea0a6tb713ljk18iltbonu3/f1/cec84944cc624611b52e5b33b7d4c9d4 2023-02-13 21:54:40,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(1912): 1d40a2b23a83649a9e9748cfa62633a1/f1 is initiating minor compaction 2023-02-13 21:54:40,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f5fa91f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:40,240 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1d40a2b23a83649a9e9748cfa62633a1/f1 in testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:40,240 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp, totalSize=10.0 K 2023-02-13 21:54:40,240 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 487630a1806e413c84daabdbb34082a6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:54:40,240 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:54:40,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testGetAfterCompaction' column='f1' 2023-02-13 21:54:40,246 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:40,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302132f4294f91e374c1bb8ca23322462e066 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302132f4294f91e374c1bb8ca23322462e066 2023-02-13 21:54:40,249 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302137733e1af0d924d0fb239a6bc13a5cfbb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202302137733e1af0d924d0fb239a6bc13a5cfbb 2023-02-13 21:54:40,249 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-13 21:54:40,249 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 21:54:40,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testGetAfterCompaction' and column='f1' 2023-02-13 21:54:40,250 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-13 21:54:40,250 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:54:40,261 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-13 21:54:40,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 965 msec 2023-02-13 21:54:40,263 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1d40a2b23a83649a9e9748cfa62633a1#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:54:40,271 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,271 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,271 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,274 DEBUG [Listener at localhost.localdomain/39503] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 21:54:40,277 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45966, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 21:54:40,278 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34815] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:40,278 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-13 21:54:40,279 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 21:54:40,279 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34815] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 21:54:40,279 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=34815] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. because compaction request was cancelled 2023-02-13 21:54:40,330 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,331 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,331 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,382 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,382 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,382 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,433 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,433 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,433 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,484 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,484 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,484 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,535 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,535 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,535 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,586 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,586 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,587 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,637 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,638 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,638 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,688 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,689 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,689 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,739 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,740 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,740 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,791 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,791 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,791 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,842 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,843 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,843 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,894 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,894 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,894 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,945 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,945 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,945 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:40,996 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,996 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:40,996 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:41,047 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,047 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,047 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:41,079 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/.tmp/f1/7f7180382057414f91cbaab8e8ead7c1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/7f7180382057414f91cbaab8e8ead7c1 2023-02-13 21:54:41,084 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 1d40a2b23a83649a9e9748cfa62633a1/f1 of 1d40a2b23a83649a9e9748cfa62633a1 into 7f7180382057414f91cbaab8e8ead7c1(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:41,084 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1d40a2b23a83649a9e9748cfa62633a1: 2023-02-13 21:54:41,084 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676325280240; duration=0sec 2023-02-13 21:54:41,084 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:54:41,098 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325279284; access_time=1676325278463; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,098 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/7f7180382057414f91cbaab8e8ead7c1; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676325281074; access_time=1676325280247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,098 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,098 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676325280125; access_time=1676325279315; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-13 21:54:41,133 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_] to archive 2023-02-13 21:54:41,134 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:41,136 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/487630a1806e413c84daabdbb34082a6 2023-02-13 21:54:41,138 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/bf2b6f5aa89f496eb2f0e39959de025f_SeqId_12_ 2023-02-13 21:54:41,149 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/7f7180382057414f91cbaab8e8ead7c1; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676325281074; access_time=1676325280247; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,149 INFO [Listener at localhost.localdomain/39503] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676325278447; access_time=1676325277628; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-13 21:54:41,275 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-13 21:54:41,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-02-13 21:54:41,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325281290"}]},"ts":"1676325281290"} 2023-02-13 21:54:41,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 21:54:41,292 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-13 21:54:41,294 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-13 21:54:41,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, UNASSIGN}] 2023-02-13 21:54:41,296 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, UNASSIGN 2023-02-13 21:54:41,297 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1d40a2b23a83649a9e9748cfa62633a1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:41,297 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676325281297"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325281297"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325281297"}]},"ts":"1676325281297"} 2023-02-13 21:54:41,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 1d40a2b23a83649a9e9748cfa62633a1, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:41,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 21:54:41,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1d40a2b23a83649a9e9748cfa62633a1, disabling compactions & flushes 2023-02-13 21:54:41,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. after waiting 0 ms 2023-02-13 21:54:41,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:41,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 21:54:41,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-13 21:54:41,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1. 2023-02-13 21:54:41,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1d40a2b23a83649a9e9748cfa62633a1: Waiting for close lock at 1676325281450Running coprocessor pre-close hooks at 1676325281450Disabling compacts and flushes for region at 1676325281451 (+1 ms)Disabling writes for close at 1676325281451Writing region close event to WAL at 1676325281452 (+1 ms)Running coprocessor post-close hooks at 1676325281462 (+10 ms)Closed at 1676325281463 (+1 ms) 2023-02-13 21:54:41,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:41,465 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=1d40a2b23a83649a9e9748cfa62633a1, regionState=CLOSED 2023-02-13 21:54:41,465 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676325281465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325281465"}]},"ts":"1676325281465"} 2023-02-13 21:54:41,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-13 21:54:41,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 1d40a2b23a83649a9e9748cfa62633a1, server=jenkins-hbase20.apache.org,34815,1676325186101 in 168 msec 2023-02-13 21:54:41,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-13 21:54:41,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=1d40a2b23a83649a9e9748cfa62633a1, UNASSIGN in 173 msec 2023-02-13 21:54:41,470 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325281470"}]},"ts":"1676325281470"} 2023-02-13 21:54:41,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-13 21:54:41,472 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-13 21:54:41,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 189 msec 2023-02-13 21:54:41,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-13 21:54:41,595 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-13 21:54:41,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-02-13 21:54:41,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,606 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,608 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 21:54:41,611 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:41,612 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1, FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/recovered.edits] 2023-02-13 21:54:41,615 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/7f7180382057414f91cbaab8e8ead7c1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/7f7180382057414f91cbaab8e8ead7c1 2023-02-13 21:54:41,616 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/f1/a01f1d952afd4a2c9bbbc38200cb4699 2023-02-13 21:54:41,619 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/recovered.edits/15.seqid to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1/recovered.edits/15.seqid 2023-02-13 21:54:41,619 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testGetAfterCompaction/1d40a2b23a83649a9e9748cfa62633a1 2023-02-13 21:54:41,619 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-13 21:54:41,620 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 21:54:41,620 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-13 21:54:41,623 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021314eaee048b214c4baddd27ef15589c51 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021314eaee048b214c4baddd27ef15589c51 2023-02-13 21:54:41,624 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-13 21:54:41,626 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,653 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-13 21:54:41,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-13 21:54:41,657 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,657 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-13 21:54:41,657 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676325281657"}]},"ts":"9223372036854775807"} 2023-02-13 21:54:41,659 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 21:54:41,659 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1d40a2b23a83649a9e9748cfa62633a1, NAME => 'testGetAfterCompaction,,1676325276508.1d40a2b23a83649a9e9748cfa62633a1.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 21:54:41,659 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-13 21:54:41,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676325281659"}]},"ts":"9223372036854775807"} 2023-02-13 21:54:41,661 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-13 21:54:41,663 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-13 21:54:41,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 63 msec 2023-02-13 21:54:41,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-13 21:54:41,710 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-13 21:54:41,721 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=256 (was 253) - Thread LEAK? -, OpenFileDescriptor=649 (was 643) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 299) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=7297 (was 6365) - AvailableMemoryMB LEAK? - 2023-02-13 21:54:41,731 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=256, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=165, AvailableMemoryMB=7295 2023-02-13 21:54:41,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 21:54:41,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-13 21:54:41,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:54:41,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-13 21:54:41,736 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:54:41,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:41,738 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:41,739 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b empty. 2023-02-13 21:54:41,739 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:41,739 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:41,740 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:41,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 empty. 2023-02-13 21:54:41,741 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f empty. 2023-02-13 21:54:41,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:41,741 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:41,741 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-13 21:54:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:42,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:42,152 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 21:54:42,154 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => bf66996b85c4bd7a85bdcb1ce93ad32b, NAME => 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:42,154 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 109ab107cd1296e4625f25be450d7a0f, NAME => 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:42,154 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9c23d853d6e8509399ae6cfe49244a13, NAME => 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:54:42,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing bf66996b85c4bd7a85bdcb1ce93ad32b, disabling compactions & flushes 2023-02-13 21:54:42,560 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. after waiting 0 ms 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,560 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,560 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for bf66996b85c4bd7a85bdcb1ce93ad32b: Waiting for close lock at 1676325282560Disabling compacts and flushes for region at 1676325282560Disabling writes for close at 1676325282560Writing region close event to WAL at 1676325282560Closed at 1676325282560 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 109ab107cd1296e4625f25be450d7a0f, disabling compactions & flushes 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 9c23d853d6e8509399ae6cfe49244a13, disabling compactions & flushes 2023-02-13 21:54:42,566 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,566 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. after waiting 0 ms 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,566 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,567 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,567 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. after waiting 0 ms 2023-02-13 21:54:42,567 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 109ab107cd1296e4625f25be450d7a0f: Waiting for close lock at 1676325282566Disabling compacts and flushes for region at 1676325282566Disabling writes for close at 1676325282566Writing region close event to WAL at 1676325282567 (+1 ms)Closed at 1676325282567 2023-02-13 21:54:42,567 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,567 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,567 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 9c23d853d6e8509399ae6cfe49244a13: Waiting for close lock at 1676325282566Disabling compacts and flushes for region at 1676325282566Disabling writes for close at 1676325282567 (+1 ms)Writing region close event to WAL at 1676325282567Closed at 1676325282567 2023-02-13 21:54:42,569 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:54:42,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325282570"}]},"ts":"1676325282570"} 2023-02-13 21:54:42,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325282570"}]},"ts":"1676325282570"} 2023-02-13 21:54:42,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325282570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325282570"}]},"ts":"1676325282570"} 2023-02-13 21:54:42,572 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 21:54:42,573 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:54:42,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325282573"}]},"ts":"1676325282573"} 2023-02-13 21:54:42,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 21:54:42,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN}] 2023-02-13 21:54:42,578 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN 2023-02-13 21:54:42,578 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN 2023-02-13 21:54:42,578 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN 2023-02-13 21:54:42,579 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:42,579 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:42,579 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:54:42,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,731 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,731 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,731 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325282731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325282731"}]},"ts":"1676325282731"} 2023-02-13 21:54:42,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325282731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325282731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325282731"}]},"ts":"1676325282731"} 2023-02-13 21:54:42,731 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325282731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325282731"}]},"ts":"1676325282731"} 2023-02-13 21:54:42,733 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:42,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:42,735 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:54:42,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:42,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 109ab107cd1296e4625f25be450d7a0f, NAME => 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 21:54:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,890 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,891 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:54:42,891 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:54:42,891 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 109ab107cd1296e4625f25be450d7a0f columnFamilyName family1 2023-02-13 21:54:42,893 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(310): Store=109ab107cd1296e4625f25be450d7a0f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,893 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,894 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2 2023-02-13 21:54:42,894 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2 2023-02-13 21:54:42,894 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 109ab107cd1296e4625f25be450d7a0f columnFamilyName family2 2023-02-13 21:54:42,895 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(310): Store=109ab107cd1296e4625f25be450d7a0f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:54:42,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:54:42,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:42,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 109ab107cd1296e4625f25be450d7a0f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71982196, jitterRate=0.07261830568313599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:54:42,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 109ab107cd1296e4625f25be450d7a0f: Running coprocessor pre-open hook at 1676325282888Writing region info on filesystem at 1676325282888Initializing all the Stores at 1676325282889 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282889Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282890 (+1 ms)Cleaning up temporary data from old regions at 1676325282898 (+8 ms)Cleaning up detritus from prior splits at 1676325282898Running coprocessor post-open hooks at 1676325282901 (+3 ms)Region opened successfully at 1676325282901 2023-02-13 21:54:42,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., pid=85, masterSystemTime=1676325282885 2023-02-13 21:54:42,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:42,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c23d853d6e8509399ae6cfe49244a13, NAME => 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 21:54:42,903 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,903 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282903"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325282903"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325282903"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325282903"}]},"ts":"1676325282903"} 2023-02-13 21:54:42,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,905 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-13 21:54:42,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 171 msec 2023-02-13 21:54:42,906 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:54:42,906 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:54:42,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN in 329 msec 2023-02-13 21:54:42,907 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c23d853d6e8509399ae6cfe49244a13 columnFamilyName family1 2023-02-13 21:54:42,907 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(310): Store=9c23d853d6e8509399ae6cfe49244a13/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,908 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,909 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2 2023-02-13 21:54:42,909 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2 2023-02-13 21:54:42,909 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c23d853d6e8509399ae6cfe49244a13 columnFamilyName family2 2023-02-13 21:54:42,910 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(310): Store=9c23d853d6e8509399ae6cfe49244a13/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:54:42,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:54:42,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:42,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9c23d853d6e8509399ae6cfe49244a13; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62592935, jitterRate=-0.06729258596897125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:54:42,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9c23d853d6e8509399ae6cfe49244a13: Running coprocessor pre-open hook at 1676325282904Writing region info on filesystem at 1676325282904Initializing all the Stores at 1676325282904Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282905 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282905Cleaning up temporary data from old regions at 1676325282912 (+7 ms)Cleaning up detritus from prior splits at 1676325282912Running coprocessor post-open hooks at 1676325282916 (+4 ms)Region opened successfully at 1676325282916 2023-02-13 21:54:42,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., pid=84, masterSystemTime=1676325282885 2023-02-13 21:54:42,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:42,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf66996b85c4bd7a85bdcb1ce93ad32b, NAME => 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 21:54:42,918 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:54:42,918 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325282918"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325282918"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325282918"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325282918"}]},"ts":"1676325282918"} 2023-02-13 21:54:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,919 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,920 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:54:42,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-13 21:54:42,920 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:54:42,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101 in 186 msec 2023-02-13 21:54:42,921 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf66996b85c4bd7a85bdcb1ce93ad32b columnFamilyName family1 2023-02-13 21:54:42,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN in 345 msec 2023-02-13 21:54:42,921 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(310): Store=bf66996b85c4bd7a85bdcb1ce93ad32b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,922 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,923 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2 2023-02-13 21:54:42,923 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2 2023-02-13 21:54:42,923 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf66996b85c4bd7a85bdcb1ce93ad32b columnFamilyName family2 2023-02-13 21:54:42,924 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(310): Store=bf66996b85c4bd7a85bdcb1ce93ad32b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:54:42,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:54:42,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:54:42,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:54:42,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bf66996b85c4bd7a85bdcb1ce93ad32b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62683111, jitterRate=-0.06594885885715485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:54:42,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bf66996b85c4bd7a85bdcb1ce93ad32b: Running coprocessor pre-open hook at 1676325282918Writing region info on filesystem at 1676325282918Initializing all the Stores at 1676325282919 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282919Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325282919Cleaning up temporary data from old regions at 1676325282925 (+6 ms)Cleaning up detritus from prior splits at 1676325282926 (+1 ms)Running coprocessor post-open hooks at 1676325282929 (+3 ms)Region opened successfully at 1676325282929 2023-02-13 21:54:42,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., pid=83, masterSystemTime=1676325282885 2023-02-13 21:54:42,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:42,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:42,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325282931"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325282931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325282931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325282931"}]},"ts":"1676325282931"} 2023-02-13 21:54:42,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-13 21:54:42,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101 in 199 msec 2023-02-13 21:54:42,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-02-13 21:54:42,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN in 358 msec 2023-02-13 21:54:42,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:54:42,935 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325282935"}]},"ts":"1676325282935"} 2023-02-13 21:54:42,936 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 21:54:42,937 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:54:42,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2040 sec 2023-02-13 21:54:43,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-13 21:54:43,842 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-13 21:54:43,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:43,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:43,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:43,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:43,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 21:54:43,863 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 21:54:43,863 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:43,863 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 21:54:43,863 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 21:54:43,863 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:43,863 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:43,864 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:43,864 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:43,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:43,864 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:43,864 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:43,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:43,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 21:54:43,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 21:54:43,865 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 21:54:43,865 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:43,865 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 21:54:43,865 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:43,865 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:43,866 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:43,866 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:43,865 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:43,865 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:54:43,866 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:43,866 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:43,866 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 109ab107cd1296e4625f25be450d7a0f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:54:43,867 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c23d853d6e8509399ae6cfe49244a13 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:54:43,867 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bf66996b85c4bd7a85bdcb1ce93ad32b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:54:43,906 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 2023-02-13 21:54:44,162 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-13 21:54:44,305 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab 2023-02-13 21:54:44,305 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f 2023-02-13 21:54:44,312 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/3c93a9c2147141339bdec390d578fca9 2023-02-13 21:54:44,317 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/583ba0fa1d724985976b5cd1dfe629ec 2023-02-13 21:54:44,713 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/359e2e8f8f69402aacf5b9b912a6b990 2023-02-13 21:54:44,732 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1 2023-02-13 21:54:44,733 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597 2023-02-13 21:54:45,129 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4 2023-02-13 21:54:45,136 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/78a1f3cbb4de4972be1d990392737601 2023-02-13 21:54:45,137 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/b2012d4e661e4175908658921dd89040 2023-02-13 21:54:45,159 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4dbf9e06 to 127.0.0.1:60489 2023-02-13 21:54:45,159 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,161 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:45,162 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ed86974 to 127.0.0.1:60489 2023-02-13 21:54:45,162 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,165 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:45,165 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bb83f81 to 127.0.0.1:60489 2023-02-13 21:54:45,165 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,165 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/3c93a9c2147141339bdec390d578fca9 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9 2023-02-13 21:54:45,167 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:45,167 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36524ed6 to 127.0.0.1:60489 2023-02-13 21:54:45,167 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,167 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:45,167 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63937d11 to 127.0.0.1:60489 2023-02-13 21:54:45,167 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,167 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:54:45,168 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66d32de9 to 127.0.0.1:60489 2023-02-13 21:54:45,168 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/583ba0fa1d724985976b5cd1dfe629ec as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec 2023-02-13 21:54:45,168 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,168 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06a5255c to 127.0.0.1:60489 2023-02-13 21:54:45,168 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:45,171 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:54:45,172 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:54:45,172 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/78a1f3cbb4de4972be1d990392737601 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601 2023-02-13 21:54:45,172 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/b2012d4e661e4175908658921dd89040 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040 2023-02-13 21:54:45,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:54:45,177 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:54:45,177 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 109ab107cd1296e4625f25be450d7a0f in 1311ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:54:45,178 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9c23d853d6e8509399ae6cfe49244a13 in 1312ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:45,178 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:45,178 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:54:45,535 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/b02443c56caa48fd8bb5a557ef19ee8b 2023-02-13 21:54:45,540 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/359e2e8f8f69402aacf5b9b912a6b990 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990 2023-02-13 21:54:45,544 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:54:45,545 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/b02443c56caa48fd8bb5a557ef19ee8b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b 2023-02-13 21:54:45,549 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:54:45,550 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bf66996b85c4bd7a85bdcb1ce93ad32b in 1683ms, sequenceid=5, compaction requested=false 2023-02-13 21:54:45,550 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:45,550 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:45,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:54:45,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:54:45,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,550 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 21:54:45,551 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 21:54:45,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,552 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:45,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,552 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 21:54:45,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ae9cdb8[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:45,553 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 21:54:45,553 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,554 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 21:54:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 21:54:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:45,554 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,554 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:45,555 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 21:54:45,555 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,555 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:45,555 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:45,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 21:54:45,556 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 21:54:45,556 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:45,556 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:45,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 21:54:45,557 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:45,557 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,557 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:45,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,557 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:45,558 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,559 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:45,560 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:45,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:45,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 21:54:45,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:45,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:45,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,560 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:45,661 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:45,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:45,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:45,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:45,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:45,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:45,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 21:54:45,675 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 21:54:45,675 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:45,675 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 21:54:45,675 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 21:54:45,675 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,675 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:45,677 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:45,677 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:45,677 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:45,677 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:45,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:45,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:45,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:45,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 21:54:45,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 21:54:45,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 21:54:45,679 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 21:54:45,679 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:45,679 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:45,680 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c23d853d6e8509399ae6cfe49244a13 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:54:45,680 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:54:45,680 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:45,680 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:45,680 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 109ab107cd1296e4625f25be450d7a0f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:54:45,680 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bf66996b85c4bd7a85bdcb1ce93ad32b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:54:45,701 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac 2023-02-13 21:54:45,701 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 2023-02-13 21:54:45,701 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b 2023-02-13 21:54:46,109 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/1ea6a71c01cc41c5ad65d433478e24a3 2023-02-13 21:54:46,109 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/0fb39a61ceea4589916a60005a6171bd 2023-02-13 21:54:46,109 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/3db2e37f21734a4aa451c581a71da587 2023-02-13 21:54:46,543 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842 2023-02-13 21:54:46,543 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c 2023-02-13 21:54:46,543 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1 2023-02-13 21:54:46,956 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/f1404ab101654fbdb73536a1cbb3d087 2023-02-13 21:54:46,956 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/935db34723c8408484efdfc82635b4a5 2023-02-13 21:54:46,956 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/7618299f867a42c88d29e7a8a3b4e6ac 2023-02-13 21:54:46,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/0fb39a61ceea4589916a60005a6171bd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd 2023-02-13 21:54:46,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/3db2e37f21734a4aa451c581a71da587 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587 2023-02-13 21:54:46,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/1ea6a71c01cc41c5ad65d433478e24a3 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3 2023-02-13 21:54:46,964 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:54:46,965 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:54:46,965 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:54:46,966 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/935db34723c8408484efdfc82635b4a5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5 2023-02-13 21:54:46,966 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/f1404ab101654fbdb73536a1cbb3d087 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087 2023-02-13 21:54:46,967 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:54:46,968 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/7618299f867a42c88d29e7a8a3b4e6ac as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac 2023-02-13 21:54:46,971 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:54:46,972 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:54:46,972 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9c23d853d6e8509399ae6cfe49244a13 in 1292ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:46,972 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 109ab107cd1296e4625f25be450d7a0f in 1292ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:46,972 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:46,972 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:46,972 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:46,972 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:46,972 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:54:46,972 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:54:46,976 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:54:46,977 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bf66996b85c4bd7a85bdcb1ce93ad32b in 1297ms, sequenceid=9, compaction requested=false 2023-02-13 21:54:46,977 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:46,977 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:46,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:54:46,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:54:46,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 21:54:46,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 21:54:46,978 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:46,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,979 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 21:54:46,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@234d2be3[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:46,979 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 21:54:46,979 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,980 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,980 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 21:54:46,980 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 21:54:46,980 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:46,980 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,980 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:46,981 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 21:54:46,981 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,981 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:46,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:46,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:46,981 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 21:54:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:46,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:46,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 21:54:46,983 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 21:54:46,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:46,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:46,983 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 21:54:46,983 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:46,984 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,984 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:46,984 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:46,985 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,986 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 21:54:46,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:46,988 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:46,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:46,988 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:46,989 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:46,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:46,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:46,989 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:47,089 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:47,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:47,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:47,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:47,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:47,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:47,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:47,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 21:54:47,103 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 21:54:47,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:47,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 21:54:47,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 21:54:47,103 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:47,104 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:47,104 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:47,104 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:47,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:47,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:47,105 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:47,105 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:47,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:47,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:47,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 21:54:47,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 21:54:47,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 21:54:47,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 21:54:47,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:47,107 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 21:54:47,108 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:47,108 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:47,108 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c23d853d6e8509399ae6cfe49244a13 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:54:47,115 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:47,116 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:54:47,116 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:47,116 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:47,116 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:47,116 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:47,116 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 109ab107cd1296e4625f25be450d7a0f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:54:47,116 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bf66996b85c4bd7a85bdcb1ce93ad32b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:54:47,144 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 2023-02-13 21:54:47,148 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e 2023-02-13 21:54:47,148 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 2023-02-13 21:54:47,164 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/17e231f9624a4d2b9da8c2e6f1d510a7 2023-02-13 21:54:47,166 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/34a7a804b3d340c4a06ca4ea911ea4cf 2023-02-13 21:54:47,566 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/a0d5f3da63dc444a82863fcacbec8d03 2023-02-13 21:54:47,584 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c 2023-02-13 21:54:47,584 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3 2023-02-13 21:54:47,589 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51 2023-02-13 21:54:47,992 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/32be0ede88ca4990a4d68b0d9d7f2b17 2023-02-13 21:54:47,992 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/61d8e8bef76c419fab8637c3de49c780 2023-02-13 21:54:47,995 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/d3eae3ec5128470586be54dbab8bee54 2023-02-13 21:54:48,000 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/34a7a804b3d340c4a06ca4ea911ea4cf as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf 2023-02-13 21:54:48,001 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/17e231f9624a4d2b9da8c2e6f1d510a7 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7 2023-02-13 21:54:48,003 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/a0d5f3da63dc444a82863fcacbec8d03 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03 2023-02-13 21:54:48,005 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:54:48,005 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:54:48,006 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/61d8e8bef76c419fab8637c3de49c780 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780 2023-02-13 21:54:48,006 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/32be0ede88ca4990a4d68b0d9d7f2b17 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17 2023-02-13 21:54:48,007 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:54:48,007 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/d3eae3ec5128470586be54dbab8bee54 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54 2023-02-13 21:54:48,010 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:54:48,010 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:54:48,011 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9c23d853d6e8509399ae6cfe49244a13 in 903ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:48,011 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bf66996b85c4bd7a85bdcb1ce93ad32b in 895ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:48,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:48,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:48,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:48,011 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:48,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:54:48,011 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:54:48,012 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:54:48,012 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 109ab107cd1296e4625f25be450d7a0f in 896ms, sequenceid=13, compaction requested=true 2023-02-13 21:54:48,013 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:48,013 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:48,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:54:48,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:54:48,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 21:54:48,013 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 21:54:48,015 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:48,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,015 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 21:54:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@487417e1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:48,016 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 21:54:48,016 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,017 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,017 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 21:54:48,017 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 21:54:48,017 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:48,017 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,017 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:48,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 21:54:48,018 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:48,018 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:48,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 21:54:48,019 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 21:54:48,020 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:48,020 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:48,020 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 21:54:48,020 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:48,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:48,020 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:48,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,021 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:48,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,021 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:48,023 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 21:54:48,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:48,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:48,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:48,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:48,023 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,124 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:48,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:48,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:48,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:48,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:54:48,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:48,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:48,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 21:54:48,129 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 21:54:48,129 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:48,129 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 21:54:48,129 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 21:54:48,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:48,130 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:48,130 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:48,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:48,131 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 21:54:48,131 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-13 21:54:48,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 21:54:48,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 21:54:48,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:48,131 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:48,132 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:54:48,132 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:48,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:48,132 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 109ab107cd1296e4625f25be450d7a0f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:54:48,132 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c23d853d6e8509399ae6cfe49244a13 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:54:48,132 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bf66996b85c4bd7a85bdcb1ce93ad32b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:54:48,154 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be 2023-02-13 21:54:48,555 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 2023-02-13 21:54:48,556 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 2023-02-13 21:54:48,559 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/9f89ed04f26e4149bc10cdb3b44e7705 2023-02-13 21:54:48,966 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/a6916e0c8dc1406d95b149a52cac48bb 2023-02-13 21:54:48,968 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/db7bea649afd4b8aaada0e0eca548085 2023-02-13 21:54:48,978 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701 2023-02-13 21:54:48,985 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/688fd3f0ca0f437daad29bd0105df18b 2023-02-13 21:54:48,989 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/9f89ed04f26e4149bc10cdb3b44e7705 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705 2023-02-13 21:54:48,992 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:54:48,993 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/688fd3f0ca0f437daad29bd0105df18b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b 2023-02-13 21:54:48,996 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:54:48,997 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 109ab107cd1296e4625f25be450d7a0f in 865ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:48,997 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:48,997 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:48,997 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:54:49,395 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd 2023-02-13 21:54:49,395 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38 2023-02-13 21:54:49,802 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/190caa27a7ab47549ad5840441ce62bf 2023-02-13 21:54:49,804 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/e6ed3032e9324cb89b91b0f867db5074 2023-02-13 21:54:49,810 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/a6916e0c8dc1406d95b149a52cac48bb as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb 2023-02-13 21:54:49,812 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/db7bea649afd4b8aaada0e0eca548085 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085 2023-02-13 21:54:49,816 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:54:49,817 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/190caa27a7ab47549ad5840441ce62bf as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf 2023-02-13 21:54:49,817 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:54:49,818 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/e6ed3032e9324cb89b91b0f867db5074 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074 2023-02-13 21:54:49,821 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:54:49,821 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:54:49,822 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9c23d853d6e8509399ae6cfe49244a13 in 1690ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:49,822 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bf66996b85c4bd7a85bdcb1ce93ad32b in 1690ms, sequenceid=17, compaction requested=true 2023-02-13 21:54:49,822 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:49,822 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:49,822 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:49,822 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 21:54:49,823 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 21:54:49,824 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,824 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:49,824 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,824 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 21:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d50d4e7[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:49,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 21:54:49,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,826 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 21:54:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 21:54:49,826 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:49,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,827 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:49,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 21:54:49,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:49,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,827 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:49,830 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 21:54:49,830 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:49,830 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:49,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 21:54:49,830 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 21:54:49,830 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:49,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:49,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:49,832 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,833 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,834 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,834 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:49,834 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:49,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:49,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 21:54:49,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:49,835 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:49,835 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:49,835 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:49,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:49,935 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:49,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:54:49,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676325289945 (current time:1676325289945). 2023-02-13 21:54:49,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 21:54:49,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] zookeeper.ReadOnlyZKClient(139): Connect 0x268deab7 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:54:49,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58adae72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:54:49,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:54:49,958 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47286, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:54:49,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x268deab7 to 127.0.0.1:60489 2023-02-13 21:54:49,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:54:49,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 21:54:49,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:54:49,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:54:49,969 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:54:49,970 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676325889970 2023-02-13 21:54:49,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:54:49,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676325289936 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 21:54:49,971 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:54:49,972 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 21:54:49,972 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-13 21:54:49,973 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 21:54:49,973 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676325889973 2023-02-13 21:54:49,976 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:49,976 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 21:54:50,076 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:50,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:50,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:54:50,081 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 21:54:50,281 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:50,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:50,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:54:50,284 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 21:54:50,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676325289936 2023-02-13 21:54:50,388 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676325289936' 2023-02-13 21:54:50,388 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 21:54:50,389 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676325289936' starting 'acquire' 2023-02-13 21:54:50,389 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676325289936', kicking off acquire phase on members. 2023-02-13 21:54:50,390 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,391 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676325289936 2023-02-13 21:54:50,391 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,391 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 21:54:50,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 21:54:50,392 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,392 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676325289936 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676325289936 2023-02-13 21:54:50,392 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676325289936 from table testCompactionWithHFileLink type FLUSH 2023-02-13 21:54:50,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676325289936 2023-02-13 21:54:50,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676325289936' with timeout 300000ms 2023-02-13 21:54:50,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 21:54:50,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676325289936' starting 'acquire' stage 2023-02-13 21:54:50,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676325289936' locally acquired 2023-02-13 21:54:50,394 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (snaptb-1676325289936) in zk 2023-02-13 21:54:50,395 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,395 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 21:54:50,396 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,396 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676325289936' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:50,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:50,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'snaptb-1676325289936' on coordinator 2023-02-13 21:54:50,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@196048f8[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:50,397 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676325289936' starting 'in-barrier' execution. 2023-02-13 21:54:50,397 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,398 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,398 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676325289936' received 'reached' from coordinator. 2023-02-13 21:54:50,398 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,398 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:50,398 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:50,399 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-13 21:54:50,399 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:50,399 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:50,400 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.' region-info for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,400 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.' region-info for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,400 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.' region-info for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,405 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 21:54:50,405 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 21:54:50,405 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb] hfiles 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705] hfiles 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085] hfiles 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b] hfiles 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,412 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf] hfiles 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074] hfiles 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,413 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074 for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,584 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:50,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:50,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:54:50,587 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. completed. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. completed. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. completed. 2023-02-13 21:54:50,819 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676325289936' locally completed 2023-02-13 21:54:50,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676325289936' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:50,822 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676325289936' has notified controller of completion 2023-02-13 21:54:50,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 21:54:50,822 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676325289936' completed. 2023-02-13 21:54:50,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676325289936' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:50,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'snaptb-1676325289936', counting down latch. Waiting for 0 more 2023-02-13 21:54:50,829 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676325289936' execution completed 2023-02-13 21:54:50,829 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:50,829 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:50,829 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676325289936 2023-02-13 21:54:50,829 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676325289936including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 21:54:50,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:50,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 21:54:50,831 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 21:54:50,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:50,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 21:54:50,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 21:54:50,832 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:50,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,835 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676325289936 2023-02-13 21:54:50,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 21:54:50,839 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676325289936 because node does not exist (not an error) 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676325289936/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676325289936 2023-02-13 21:54:50,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:50,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 21:54:50,840 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-13 21:54:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 21:54:50,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676325289936 2023-02-13 21:54:50,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-13 21:54:50,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 21:54:50,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9] mob files 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 2023-02-13 21:54:50,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 2023-02-13 21:54:50,843 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd] mob files 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c 2023-02-13 21:54:50,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd 2023-02-13 21:54:51,088 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:51,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:51,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:54:51,089 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 21:54:51,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676325289936 2023-02-13 21:54:51,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/snaptb-1676325289936 2023-02-13 21:54:51,789 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-13 21:54:51,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/snaptb-1676325289936 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/snaptb-1676325289936 2023-02-13 21:54:52,089 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:52,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:52,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:54:52,091 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-13 21:54:52,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676325289936 of table testCompactionWithHFileLink completed 2023-02-13 21:54:52,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/snaptb-1676325289936 2023-02-13 21:54:52,636 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/snaptb-1676325289936 2023-02-13 21:54:52,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676325289936 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676325289970Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676325291251 (+1281 ms)Consolidate snapshot: snaptb-1676325289936 at 1676325291251Loading Region manifests for snaptb-1676325289936 at 1676325291251Writing data manifest for snaptb-1676325289936 at 1676325291267 (+16 ms)Verifying snapshot: snaptb-1676325289936 at 1676325291790 (+523 ms)Snapshot snaptb-1676325289936 of table testCompactionWithHFileLink completed at 1676325292636 (+846 ms) 2023-02-13 21:54:52,638 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-13 21:54:52,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.6670 sec 2023-02-13 21:54:54,091 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:54:54,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:54:54,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 21:54:54,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:54:54,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-13 21:54:54,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-13 21:54:54,136 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-13 21:54:54,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:54,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-13 21:54:54,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-13 21:54:54,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:54,136 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:54,137 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:54,137 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:54,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:54,137 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:54,137 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:54:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:54,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:54:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:54,138 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-13 21:54:54,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-13 21:54:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-13 21:54:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:54:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-13 21:54:54,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:54:54,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:54,139 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. started... 2023-02-13 21:54:54,139 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:54:54,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. started... 2023-02-13 21:54:54,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:54,139 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing bf66996b85c4bd7a85bdcb1ce93ad32b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:54:54,139 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9c23d853d6e8509399ae6cfe49244a13 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:54:54,139 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. started... 2023-02-13 21:54:54,139 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 109ab107cd1296e4625f25be450d7a0f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:54:54,959 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/f24a6ce29dc94632a8473cf123866824 2023-02-13 21:54:54,959 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/90f016b99f824ff9ad0f0ae04e486723 2023-02-13 21:54:54,960 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/6b379faabc894194b2e43f065f899eea 2023-02-13 21:54:54,962 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24a6ce29dc94632a8473cf123866824 2023-02-13 21:54:54,963 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b379faabc894194b2e43f065f899eea 2023-02-13 21:54:54,963 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90f016b99f824ff9ad0f0ae04e486723 2023-02-13 21:54:55,793 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/5f268a799560404e81c0e1eb03f69abe 2023-02-13 21:54:55,793 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/221a6c9536ec424093f3a038eeef0441 2023-02-13 21:54:55,793 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/8f98ba7054c24c98ac0fa28c9566a1ba 2023-02-13 21:54:55,801 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f98ba7054c24c98ac0fa28c9566a1ba 2023-02-13 21:54:55,801 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221a6c9536ec424093f3a038eeef0441 2023-02-13 21:54:55,801 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f268a799560404e81c0e1eb03f69abe 2023-02-13 21:54:55,802 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/f24a6ce29dc94632a8473cf123866824 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824 2023-02-13 21:54:55,802 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/6b379faabc894194b2e43f065f899eea as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea 2023-02-13 21:54:55,802 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/90f016b99f824ff9ad0f0ae04e486723 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b379faabc894194b2e43f065f899eea 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90f016b99f824ff9ad0f0ae04e486723 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f24a6ce29dc94632a8473cf123866824 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,806 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824, entries=3, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,807 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/5f268a799560404e81c0e1eb03f69abe as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe 2023-02-13 21:54:55,807 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/221a6c9536ec424093f3a038eeef0441 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441 2023-02-13 21:54:55,807 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/8f98ba7054c24c98ac0fa28c9566a1ba as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f268a799560404e81c0e1eb03f69abe 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f98ba7054c24c98ac0fa28c9566a1ba 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221a6c9536ec424093f3a038eeef0441 2023-02-13 21:54:55,815 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441, entries=1, sequenceid=24, filesize=5.0 K 2023-02-13 21:54:55,816 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 109ab107cd1296e4625f25be450d7a0f in 1677ms, sequenceid=24, compaction requested=true 2023-02-13 21:54:55,816 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bf66996b85c4bd7a85bdcb1ce93ad32b in 1677ms, sequenceid=24, compaction requested=true 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:55,816 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9c23d853d6e8509399ae6cfe49244a13 in 1677ms, sequenceid=24, compaction requested=true 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:54:55,816 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-13 21:54:55,816 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-13 21:54:55,818 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,818 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:55,818 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,818 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-13 21:54:55,819 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-13 21:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53b86a04[Count = 0] remaining members to acquire global barrier 2023-02-13 21:54:55,819 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,820 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-13 21:54:55,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-13 21:54:55,820 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,820 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:54:55,820 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-13 21:54:55,821 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-13 21:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:54:55,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-13 21:54:55,823 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-13 21:54:55,823 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:54:55,823 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:54:55,823 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-13 21:54:55,823 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:54:55,824 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,824 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:54:55,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,824 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:54:55,825 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:54:55,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,826 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:54:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-13 21:54:55,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:55,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:54:55,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-13 21:54:55,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:54:55,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:54:55,827 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:54:55,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:54:55,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-13 21:54:55,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-13 21:54:55,827 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-13 21:54:55,927 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:54:55,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:54:55,929 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:54:55,929 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 9c23d853d6e8509399ae6cfe49244a13/family1 is initiating major compaction (all files) 2023-02-13 21:54:55,929 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:54:55,930 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:54:55,930 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 9c23d853d6e8509399ae6cfe49244a13/family1 in testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:55,930 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp, totalSize=26.7 K 2023-02-13 21:54:55,930 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 583ba0fa1d724985976b5cd1dfe629ec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283851 2023-02-13 21:54:55,931 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 0fb39a61ceea4589916a60005a6171bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:54:55,931 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 34a7a804b3d340c4a06ca4ea911ea4cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:54:55,932 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting a6916e0c8dc1406d95b149a52cac48bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:54:55,932 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f24a6ce29dc94632a8473cf123866824, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:54:55,944 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 9c23d853d6e8509399ae6cfe49244a13#family1#compaction#108 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:54:56,355 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del 2023-02-13 21:54:56,356 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del 2023-02-13 21:54:57,171 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7ac51f69ee84dc59c3520814aa1d979 2023-02-13 21:54:57,172 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/e7ac51f69ee84dc59c3520814aa1d979 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/e7ac51f69ee84dc59c3520814aa1d979 2023-02-13 21:54:57,176 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e7ac51f69ee84dc59c3520814aa1d979 2023-02-13 21:54:57,177 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c23d853d6e8509399ae6cfe49244a13/family1 of 9c23d853d6e8509399ae6cfe49244a13 into e7ac51f69ee84dc59c3520814aa1d979(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:54:57,177 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:57,177 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:54:57,177 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 9c23d853d6e8509399ae6cfe49244a13/family2 is initiating major compaction (all files) 2023-02-13 21:54:57,177 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:54:57,178 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:54:57,178 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 9c23d853d6e8509399ae6cfe49244a13/family2 in testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:54:57,178 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp, totalSize=25.4 K 2023-02-13 21:54:57,179 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting b2012d4e661e4175908658921dd89040, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283851 2023-02-13 21:54:57,179 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 935db34723c8408484efdfc82635b4a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:54:57,180 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 61d8e8bef76c419fab8637c3de49c780, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:54:57,180 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 190caa27a7ab47549ad5840441ce62bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:54:57,180 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 8f98ba7054c24c98ac0fa28c9566a1ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:54:57,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824] to archive 2023-02-13 21:54:57,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:57,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/583ba0fa1d724985976b5cd1dfe629ec 2023-02-13 21:54:57,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/0fb39a61ceea4589916a60005a6171bd 2023-02-13 21:54:57,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/34a7a804b3d340c4a06ca4ea911ea4cf 2023-02-13 21:54:57,200 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 9c23d853d6e8509399ae6cfe49244a13#family2#compaction#109 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:54:57,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/a6916e0c8dc1406d95b149a52cac48bb 2023-02-13 21:54:57,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f24a6ce29dc94632a8473cf123866824 2023-02-13 21:54:57,620 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del 2023-02-13 21:54:57,620 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del 2023-02-13 21:54:58,070 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fc5607fc323484099f492618ac47e12 2023-02-13 21:54:58,071 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/7fc5607fc323484099f492618ac47e12 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/7fc5607fc323484099f492618ac47e12 2023-02-13 21:54:58,075 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fc5607fc323484099f492618ac47e12 2023-02-13 21:54:58,076 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c23d853d6e8509399ae6cfe49244a13/family2 of 9c23d853d6e8509399ae6cfe49244a13 into 7fc5607fc323484099f492618ac47e12(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:54:58,076 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:54:58,076 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:54:58,076 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 109ab107cd1296e4625f25be450d7a0f/family1 is initiating major compaction (all files) 2023-02-13 21:54:58,077 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:54:58,077 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:54:58,077 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 109ab107cd1296e4625f25be450d7a0f/family1 in testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:58,077 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp, totalSize=26.7 K 2023-02-13 21:54:58,077 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 3c93a9c2147141339bdec390d578fca9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283853 2023-02-13 21:54:58,078 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 3db2e37f21734a4aa451c581a71da587, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285666 2023-02-13 21:54:58,078 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting a0d5f3da63dc444a82863fcacbec8d03, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:54:58,079 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 9f89ed04f26e4149bc10cdb3b44e7705, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288126 2023-02-13 21:54:58,079 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 90f016b99f824ff9ad0f0ae04e486723, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:54:58,090 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 109ab107cd1296e4625f25be450d7a0f#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:54:58,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba] to archive 2023-02-13 21:54:58,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:58,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/b2012d4e661e4175908658921dd89040 2023-02-13 21:54:58,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/935db34723c8408484efdfc82635b4a5 2023-02-13 21:54:58,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/61d8e8bef76c419fab8637c3de49c780 2023-02-13 21:54:58,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/190caa27a7ab47549ad5840441ce62bf 2023-02-13 21:54:58,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/8f98ba7054c24c98ac0fa28c9566a1ba 2023-02-13 21:54:58,503 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del 2023-02-13 21:54:58,504 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del 2023-02-13 21:54:59,323 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00bd65f8e1454a5c8520e8c2fb3e986e 2023-02-13 21:54:59,324 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/00bd65f8e1454a5c8520e8c2fb3e986e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/00bd65f8e1454a5c8520e8c2fb3e986e 2023-02-13 21:54:59,330 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00bd65f8e1454a5c8520e8c2fb3e986e 2023-02-13 21:54:59,331 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 109ab107cd1296e4625f25be450d7a0f/family1 of 109ab107cd1296e4625f25be450d7a0f into 00bd65f8e1454a5c8520e8c2fb3e986e(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:54:59,331 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:54:59,332 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:54:59,332 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 109ab107cd1296e4625f25be450d7a0f/family2 is initiating major compaction (all files) 2023-02-13 21:54:59,332 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:54:59,332 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:54:59,332 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 109ab107cd1296e4625f25be450d7a0f/family2 in testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:54:59,332 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp, totalSize=25.4 K 2023-02-13 21:54:59,333 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 78a1f3cbb4de4972be1d990392737601, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283853 2023-02-13 21:54:59,334 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f1404ab101654fbdb73536a1cbb3d087, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285666 2023-02-13 21:54:59,334 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting d3eae3ec5128470586be54dbab8bee54, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:54:59,335 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 688fd3f0ca0f437daad29bd0105df18b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288126 2023-02-13 21:54:59,336 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 5f268a799560404e81c0e1eb03f69abe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:54:59,351 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 109ab107cd1296e4625f25be450d7a0f#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:54:59,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723] to archive 2023-02-13 21:54:59,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:54:59,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3c93a9c2147141339bdec390d578fca9 2023-02-13 21:54:59,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/3db2e37f21734a4aa451c581a71da587 2023-02-13 21:54:59,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/a0d5f3da63dc444a82863fcacbec8d03 2023-02-13 21:54:59,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/9f89ed04f26e4149bc10cdb3b44e7705 2023-02-13 21:54:59,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/90f016b99f824ff9ad0f0ae04e486723 2023-02-13 21:54:59,760 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del 2023-02-13 21:54:59,761 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del 2023-02-13 21:55:00,182 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca395428f5934e95832b05bec98576e7 2023-02-13 21:55:00,183 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/ca395428f5934e95832b05bec98576e7 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/ca395428f5934e95832b05bec98576e7 2023-02-13 21:55:00,187 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca395428f5934e95832b05bec98576e7 2023-02-13 21:55:00,188 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 109ab107cd1296e4625f25be450d7a0f/family2 of 109ab107cd1296e4625f25be450d7a0f into ca395428f5934e95832b05bec98576e7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:00,188 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:55:00,188 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:00,188 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): bf66996b85c4bd7a85bdcb1ce93ad32b/family1 is initiating major compaction (all files) 2023-02-13 21:55:00,188 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:00,189 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:00,189 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of bf66996b85c4bd7a85bdcb1ce93ad32b/family1 in testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:00,189 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp, totalSize=26.7 K 2023-02-13 21:55:00,190 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 359e2e8f8f69402aacf5b9b912a6b990, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283850 2023-02-13 21:55:00,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe] to archive 2023-02-13 21:55:00,190 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 1ea6a71c01cc41c5ad65d433478e24a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:00,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:00,191 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 17e231f9624a4d2b9da8c2e6f1d510a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:00,192 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting db7bea649afd4b8aaada0e0eca548085, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:00,193 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 6b379faabc894194b2e43f065f899eea, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:55:00,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/78a1f3cbb4de4972be1d990392737601 2023-02-13 21:55:00,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/f1404ab101654fbdb73536a1cbb3d087 2023-02-13 21:55:00,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/d3eae3ec5128470586be54dbab8bee54 2023-02-13 21:55:00,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/688fd3f0ca0f437daad29bd0105df18b 2023-02-13 21:55:00,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/5f268a799560404e81c0e1eb03f69abe 2023-02-13 21:55:00,219 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): bf66996b85c4bd7a85bdcb1ce93ad32b#family1#compaction#112 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:00,229 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del 2023-02-13 21:55:00,230 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del 2023-02-13 21:55:01,063 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 806233f8c518489694bee3c5d77cf810 2023-02-13 21:55:01,065 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/806233f8c518489694bee3c5d77cf810 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/806233f8c518489694bee3c5d77cf810 2023-02-13 21:55:01,070 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 806233f8c518489694bee3c5d77cf810 2023-02-13 21:55:01,071 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bf66996b85c4bd7a85bdcb1ce93ad32b/family1 of bf66996b85c4bd7a85bdcb1ce93ad32b into 806233f8c518489694bee3c5d77cf810(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:01,071 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:01,071 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:01,071 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): bf66996b85c4bd7a85bdcb1ce93ad32b/family2 is initiating major compaction (all files) 2023-02-13 21:55:01,071 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:01,071 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:01,071 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of bf66996b85c4bd7a85bdcb1ce93ad32b/family2 in testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:01,072 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp, totalSize=25.4 K 2023-02-13 21:55:01,072 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting b02443c56caa48fd8bb5a557ef19ee8b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283850 2023-02-13 21:55:01,073 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 7618299f867a42c88d29e7a8a3b4e6ac, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:01,073 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 32be0ede88ca4990a4d68b0d9d7f2b17, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:01,073 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting e6ed3032e9324cb89b91b0f867db5074, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:01,074 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 221a6c9536ec424093f3a038eeef0441, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-13 21:55:01,084 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): bf66996b85c4bd7a85bdcb1ce93ad32b#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:01,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea] to archive 2023-02-13 21:55:01,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:01,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/359e2e8f8f69402aacf5b9b912a6b990 2023-02-13 21:55:01,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/1ea6a71c01cc41c5ad65d433478e24a3 2023-02-13 21:55:01,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/17e231f9624a4d2b9da8c2e6f1d510a7 2023-02-13 21:55:01,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/db7bea649afd4b8aaada0e0eca548085 2023-02-13 21:55:01,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/6b379faabc894194b2e43f065f899eea 2023-02-13 21:55:01,496 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del 2023-02-13 21:55:01,497 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del 2023-02-13 21:55:02,321 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efbe0ec6e36246e690ce79840e69494b 2023-02-13 21:55:02,322 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/efbe0ec6e36246e690ce79840e69494b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/efbe0ec6e36246e690ce79840e69494b 2023-02-13 21:55:02,328 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efbe0ec6e36246e690ce79840e69494b 2023-02-13 21:55:02,329 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bf66996b85c4bd7a85bdcb1ce93ad32b/family2 of bf66996b85c4bd7a85bdcb1ce93ad32b into efbe0ec6e36246e690ce79840e69494b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:02,329 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:02,336 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:02,341 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:02,346 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:02,347 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:02,352 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:55:02,386 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 21:55:02,390 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del 2023-02-13 21:55:02,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441] to archive 2023-02-13 21:55:02,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:02,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/b02443c56caa48fd8bb5a557ef19ee8b 2023-02-13 21:55:02,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/7618299f867a42c88d29e7a8a3b4e6ac 2023-02-13 21:55:02,394 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del 2023-02-13 21:55:02,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/32be0ede88ca4990a4d68b0d9d7f2b17 2023-02-13 21:55:02,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/e6ed3032e9324cb89b91b0f867db5074 2023-02-13 21:55:02,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/221a6c9536ec424093f3a038eeef0441 2023-02-13 21:55:02,397 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del 2023-02-13 21:55:02,397 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:02,398 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(139): Connect 0x2bd70d63 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:02,402 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ac26024, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:02,403 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:02,403 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:02,403 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:03,266 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95 2023-02-13 21:55:03,266 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e 2023-02-13 21:55:03,267 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,268 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,278 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6 2023-02-13 21:55:03,279 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,285 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:03,290 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:03,295 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:55:03,297 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38860, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:55:03,310 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/60eabb3d37c24569a5c99f9334627699 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 21:55:03,313 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/60eabb3d37c24569a5c99f9334627699}] 2023-02-13 21:55:03,317 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1b238f019ac544b2a9eae96589702141 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 21:55:03,317 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/e053943f9b044962a2ccde97f8a85094 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 21:55:03,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/e053943f9b044962a2ccde97f8a85094}] 2023-02-13 21:55:03,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1b238f019ac544b2a9eae96589702141}] 2023-02-13 21:55:03,320 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/60eabb3d37c24569a5c99f9334627699 for inclusion in 109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:03,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1b238f019ac544b2a9eae96589702141 for inclusion in 9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:03,322 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/e053943f9b044962a2ccde97f8a85094 for inclusion in bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 21:55:03,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/60eabb3d37c24569a5c99f9334627699 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__uga6930rlhdll051hf57mfq79gmodhlbo8currjoonq9rcptlrqb3kvsmds103fn/family1/60eabb3d37c24569a5c99f9334627699 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/1b238f019ac544b2a9eae96589702141 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__4mqlarvdj047r7apb34245gc0v6sp7bckf9ae98811qvlhad5bklg0h9cv0b4tau/family1/1b238f019ac544b2a9eae96589702141 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:03,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/e053943f9b044962a2ccde97f8a85094 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__tdei8jufrn7nrhdu62dprmfr2esmkukl9mn8i8mr3alilj46t3n191gi1l0s0e8b/family1/e053943f9b044962a2ccde97f8a85094 2023-02-13 21:55:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__uga6930rlhdll051hf57mfq79gmodhlbo8currjoonq9rcptlrqb3kvsmds103fn/family1/60eabb3d37c24569a5c99f9334627699 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ 2023-02-13 21:55:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__4mqlarvdj047r7apb34245gc0v6sp7bckf9ae98811qvlhad5bklg0h9cv0b4tau/family1/1b238f019ac544b2a9eae96589702141 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ 2023-02-13 21:55:03,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__uga6930rlhdll051hf57mfq79gmodhlbo8currjoonq9rcptlrqb3kvsmds103fn/family1/60eabb3d37c24569a5c99f9334627699 into 109ab107cd1296e4625f25be450d7a0f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ - updating store file list. 2023-02-13 21:55:03,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__4mqlarvdj047r7apb34245gc0v6sp7bckf9ae98811qvlhad5bklg0h9cv0b4tau/family1/1b238f019ac544b2a9eae96589702141 into 9c23d853d6e8509399ae6cfe49244a13/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ - updating store file list. 2023-02-13 21:55:03,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__tdei8jufrn7nrhdu62dprmfr2esmkukl9mn8i8mr3alilj46t3n191gi1l0s0e8b/family1/e053943f9b044962a2ccde97f8a85094 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ 2023-02-13 21:55:03,328 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__tdei8jufrn7nrhdu62dprmfr2esmkukl9mn8i8mr3alilj46t3n191gi1l0s0e8b/family1/e053943f9b044962a2ccde97f8a85094 into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ - updating store file list. 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ into 9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ into 109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__4mqlarvdj047r7apb34245gc0v6sp7bckf9ae98811qvlhad5bklg0h9cv0b4tau/family1/1b238f019ac544b2a9eae96589702141 into 9c23d853d6e8509399ae6cfe49244a13/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_) 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__uga6930rlhdll051hf57mfq79gmodhlbo8currjoonq9rcptlrqb3kvsmds103fn/family1/60eabb3d37c24569a5c99f9334627699 into 109ab107cd1296e4625f25be450d7a0f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_) 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:03,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__tdei8jufrn7nrhdu62dprmfr2esmkukl9mn8i8mr3alilj46t3n191gi1l0s0e8b/family1/e053943f9b044962a2ccde97f8a85094 into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_) 2023-02-13 21:55:03,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__4mqlarvdj047r7apb34245gc0v6sp7bckf9ae98811qvlhad5bklg0h9cv0b4tau/family1/1b238f019ac544b2a9eae96589702141 2023-02-13 21:55:03,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__uga6930rlhdll051hf57mfq79gmodhlbo8currjoonq9rcptlrqb3kvsmds103fn/family1/60eabb3d37c24569a5c99f9334627699 2023-02-13 21:55:03,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__tdei8jufrn7nrhdu62dprmfr2esmkukl9mn8i8mr3alilj46t3n191gi1l0s0e8b/family1/e053943f9b044962a2ccde97f8a85094 2023-02-13 21:55:03,332 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,332 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,332 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,332 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,332 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,332 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,333 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f 2023-02-13 21:55:03,334 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 2023-02-13 21:55:03,334 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 2023-02-13 21:55:03,334 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b 2023-02-13 21:55:03,334 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac 2023-02-13 21:55:03,335 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab 2023-02-13 21:55:03,335 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be 2023-02-13 21:55:03,335 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e 2023-02-13 21:55:03,336 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 2023-02-13 21:55:03,336 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 2023-02-13 21:55:03,336 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:03,336 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 21:55:03,336 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 21:55:03,337 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:03,337 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:03,337 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:03,337 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:03,337 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del] 2023-02-13 21:55:03,337 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,338 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213ceb2e1b72df046e2b5c0b431f87cfacc_del 2023-02-13 21:55:03,338 INFO [Listener at localhost.localdomain/39503] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 21:55:03,338 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del] 2023-02-13 21:55:03,339 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,339 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230213c9a32869704a4d7c9fff3270f566f5ca_del 2023-02-13 21:55:03,339 INFO [Listener at localhost.localdomain/39503] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 21:55:03,339 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del] 2023-02-13 21:55:03,340 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:03,340 DEBUG [Listener at localhost.localdomain/39503] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230213a8d99f4b41d74f1c91fc9febdb7c250b_del 2023-02-13 21:55:03,341 INFO [Listener at localhost.localdomain/39503] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-13 21:55:03,343 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:03,345 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:03,348 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:03,349 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:03,354 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-13 21:55:03,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-02-13 21:55:03,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-13 21:55:03,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 21:55:03,358 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325303358"}]},"ts":"1676325303358"} 2023-02-13 21:55:03,359 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-13 21:55:03,360 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-13 21:55:03,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, UNASSIGN}] 2023-02-13 21:55:03,362 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, UNASSIGN 2023-02-13 21:55:03,362 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, UNASSIGN 2023-02-13 21:55:03,362 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, UNASSIGN 2023-02-13 21:55:03,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:03,363 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:03,363 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:03,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325303363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325303363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325303363"}]},"ts":"1676325303363"} 2023-02-13 21:55:03,363 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325303363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325303363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325303363"}]},"ts":"1676325303363"} 2023-02-13 21:55:03,363 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325303363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325303363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325303363"}]},"ts":"1676325303363"} 2023-02-13 21:55:03,364 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:03,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:03,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:03,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 21:55:03,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bf66996b85c4bd7a85bdcb1ce93ad32b, disabling compactions & flushes 2023-02-13 21:55:03,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. after waiting 0 ms 2023-02-13 21:55:03,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:03,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 21:55:03,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:03,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bf66996b85c4bd7a85bdcb1ce93ad32b: Waiting for close lock at 1676325303516Running coprocessor pre-close hooks at 1676325303516Disabling compacts and flushes for region at 1676325303516Disabling writes for close at 1676325303516Writing region close event to WAL at 1676325303517 (+1 ms)Running coprocessor post-close hooks at 1676325303520 (+3 ms)Closed at 1676325303521 (+1 ms) 2023-02-13 21:55:03,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:03,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:03,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 109ab107cd1296e4625f25be450d7a0f, disabling compactions & flushes 2023-02-13 21:55:03,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:03,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=CLOSED 2023-02-13 21:55:03,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:03,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. after waiting 0 ms 2023-02-13 21:55:03,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:03,523 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325303522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325303522"}]},"ts":"1676325303522"} 2023-02-13 21:55:03,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-02-13 21:55:03,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101 in 160 msec 2023-02-13 21:55:03,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 21:55:03,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, UNASSIGN in 164 msec 2023-02-13 21:55:03,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:03,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 109ab107cd1296e4625f25be450d7a0f: Waiting for close lock at 1676325303522Running coprocessor pre-close hooks at 1676325303522Disabling compacts and flushes for region at 1676325303522Disabling writes for close at 1676325303523 (+1 ms)Writing region close event to WAL at 1676325303524 (+1 ms)Running coprocessor post-close hooks at 1676325303527 (+3 ms)Closed at 1676325303527 2023-02-13 21:55:03,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:03,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:03,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9c23d853d6e8509399ae6cfe49244a13, disabling compactions & flushes 2023-02-13 21:55:03,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:03,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:03,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. after waiting 0 ms 2023-02-13 21:55:03,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:03,529 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=CLOSED 2023-02-13 21:55:03,529 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325303529"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325303529"}]},"ts":"1676325303529"} 2023-02-13 21:55:03,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-13 21:55:03,531 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 165 msec 2023-02-13 21:55:03,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, UNASSIGN in 170 msec 2023-02-13 21:55:03,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-13 21:55:03,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:03,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9c23d853d6e8509399ae6cfe49244a13: Waiting for close lock at 1676325303529Running coprocessor pre-close hooks at 1676325303529Disabling compacts and flushes for region at 1676325303529Disabling writes for close at 1676325303529Writing region close event to WAL at 1676325303530 (+1 ms)Running coprocessor post-close hooks at 1676325303532 (+2 ms)Closed at 1676325303533 (+1 ms) 2023-02-13 21:55:03,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:03,534 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=CLOSED 2023-02-13 21:55:03,534 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325303534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325303534"}]},"ts":"1676325303534"} 2023-02-13 21:55:03,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-02-13 21:55:03,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101 in 170 msec 2023-02-13 21:55:03,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-13 21:55:03,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, UNASSIGN in 175 msec 2023-02-13 21:55:03,538 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325303538"}]},"ts":"1676325303538"} 2023-02-13 21:55:03,539 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-13 21:55:03,540 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-13 21:55:03,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 185 msec 2023-02-13 21:55:03,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-13 21:55:03,660 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-13 21:55:03,675 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:03,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:55:03,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676325303676 (current time:1676325303676). 2023-02-13 21:55:03,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 21:55:03,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] zookeeper.ReadOnlyZKClient(139): Connect 0x5afcf5a1 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:03,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47154cfb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:03,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:03,686 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:03,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5afcf5a1 to 127.0.0.1:60489 2023-02-13 21:55:03,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 21:55:03,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:55:03,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:55:03,692 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:55:03,693 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676325903693 2023-02-13 21:55:03,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:55:03,693 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676325289936-1676325303675 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-13 21:55:03,694 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:03,694 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 21:55:03,794 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:55:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:55:03,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:55:03,796 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 21:55:03,996 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:55:03,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:55:03,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:55:03,998 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 21:55:04,104 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-13 21:55:04,107 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 21:55:04,107 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 21:55:04,107 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 21:55:04,107 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 21:55:04,108 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-13 21:55:04,108 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 21:55:04,107 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 21:55:04,108 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/e7ac51f69ee84dc59c3520814aa1d979] hfiles 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/00bd65f8e1454a5c8520e8c2fb3e986e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_] hfiles 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/806233f8c518489694bee3c5d77cf810] hfiles 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/00bd65f8e1454a5c8520e8c2fb3e986e 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95] hfiles 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/e7ac51f69ee84dc59c3520814aa1d979 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e 2023-02-13 21:55:04,112 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/806233f8c518489694bee3c5d77cf810 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/7fc5607fc323484099f492618ac47e12] hfiles 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/ca395428f5934e95832b05bec98576e7] hfiles 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/7fc5607fc323484099f492618ac47e12 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/ca395428f5934e95832b05bec98576e7 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/efbe0ec6e36246e690ce79840e69494b] hfiles 2023-02-13 21:55:04,113 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/efbe0ec6e36246e690ce79840e69494b 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd] hfiles 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213149f68d5167646f587e6c0b3c890077c 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302137314ff22adb947299acc23b76cb91d38 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213d3651879436c41a9a3e4cf467bc94597 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230213db9763bb28fb4ae4980ee48dee7e27a1 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021344b2d86f65154800a02732dd3287c701 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302135cba6f38386446f1a0047c16286d5842 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213e031a9b59c6540bd8285145fc72d3f51 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213eaa4d28cdeec4bdea894b42880490ac1 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302138e65f169aa5c4f8c897fd6c7c676dfa3 2023-02-13 21:55:04,121 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213c68240b1bec74ae2bb6c5e72d062a1c4 2023-02-13 21:55:04,122 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213d4f72b7fba954540bf89a297a393584c 2023-02-13 21:55:04,122 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213eb2acae79a9e4f13a2d5fbfdf658a3cd 2023-02-13 21:55:04,298 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:55:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:55:04,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:55:04,300 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 21:55:04,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-13 21:55:04,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:04,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:04,800 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:55:04,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:55:04,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-13 21:55:04,802 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 21:55:04,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676325289936-1676325303675 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:05,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676325289936-1676325303675 of table testCompactionWithHFileLink completed 2023-02-13 21:55:05,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:05,377 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:05,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676325289936-1676325303675 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676325303694Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676325304104 (+410 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676325289936-1676325303675 at 1676325304528 (+424 ms)Loading Region manifests for hbase-failsafe-snaptb-1676325289936-1676325303675 at 1676325304528Writing data manifest for hbase-failsafe-snaptb-1676325289936-1676325303675 at 1676325304533 (+5 ms)Verifying snapshot: hbase-failsafe-snaptb-1676325289936-1676325303675 at 1676325304946 (+413 ms)Snapshot hbase-failsafe-snaptb-1676325289936-1676325303675 of table testCompactionWithHFileLink completed at 1676325305376 (+430 ms) 2023-02-13 21:55:05,378 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-13 21:55:05,380 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6870 sec 2023-02-13 21:55:05,802 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 21:55:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-13 21:55:05,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676325289936-1676325303675 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 21:55:05,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676325289936" table: "testCompactionWithHFileLink" creation_time: 1676325289945 type: FLUSH version: 2 ttl: 0 ) 2023-02-13 21:55:05,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676325289936 as table=testCompactionWithHFileLink 2023-02-13 21:55:05,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 21:55:05,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 21:55:06,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 21:55:06,253 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 21:55:06,254 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-13 21:55:06,254 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-13 21:55:06,255 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-13 21:55:06,260 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676325289936" table: "testCompactionWithHFileLink" creation_time: 1676325289945 type: FLUSH version: 2 ttl: 0 2023-02-13 21:55:06,260 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink 2023-02-13 21:55:06,268 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-13 21:55:06,271 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302130e3607f7a0004b26bbdbb101abed74a6 2023-02-13 21:55:06,273 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302133537395044654fdd914bac0f1a311d95 2023-02-13 21:55:06,274 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021332ed322f7ca949d6a3861cde495c550e 2023-02-13 21:55:06,274 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,278 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,282 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,285 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,290 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,294 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,297 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,303 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,311 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,316 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,320 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,324 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 of snapshot=snaptb-1676325289936 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-13 21:55:06,331 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023021353caf7184ecf4721b68e64ef3e030731_del 2023-02-13 21:55:06,333 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230213a3a16b47858b49819f899c5d41b22a71_del 2023-02-13 21:55:06,334 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230213303de99137594ca1b408634ffcda5fe7_del 2023-02-13 21:55:06,334 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:06,334 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,334 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:06,337 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/2bf8f2f3755548bebdbc2424a875483e_SeqId_29_ 2023-02-13 21:55:06,338 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/bdd1fd3813b14a2b96dadfe666fbece4_SeqId_29_ 2023-02-13 21:55:06,338 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/00bd65f8e1454a5c8520e8c2fb3e986e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/00bd65f8e1454a5c8520e8c2fb3e986e 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/806233f8c518489694bee3c5d77cf810 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/806233f8c518489694bee3c5d77cf810 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 359e2e8f8f69402aacf5b9b912a6b990 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/e7ac51f69ee84dc59c3520814aa1d979 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/e7ac51f69ee84dc59c3520814aa1d979 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 583ba0fa1d724985976b5cd1dfe629ec of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/74225e00111a438ab43da883908918fd_SeqId_29_ 2023-02-13 21:55:06,339 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3c93a9c2147141339bdec390d578fca9 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,347 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1ea6a71c01cc41c5ad65d433478e24a3 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,347 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3db2e37f21734a4aa451c581a71da587 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,347 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0fb39a61ceea4589916a60005a6171bd of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,350 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a0d5f3da63dc444a82863fcacbec8d03 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,350 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 17e231f9624a4d2b9da8c2e6f1d510a7 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,350 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 34a7a804b3d340c4a06ca4ea911ea4cf of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,353 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9f89ed04f26e4149bc10cdb3b44e7705 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,354 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a6916e0c8dc1406d95b149a52cac48bb of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,354 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink db7bea649afd4b8aaada0e0eca548085 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,365 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/ca395428f5934e95832b05bec98576e7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/ca395428f5934e95832b05bec98576e7 2023-02-13 21:55:06,366 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 78a1f3cbb4de4972be1d990392737601 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,366 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/7fc5607fc323484099f492618ac47e12 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/7fc5607fc323484099f492618ac47e12 2023-02-13 21:55:06,366 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b2012d4e661e4175908658921dd89040 of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,368 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f1404ab101654fbdb73536a1cbb3d087 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,368 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 935db34723c8408484efdfc82635b4a5 of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,368 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/efbe0ec6e36246e690ce79840e69494b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/efbe0ec6e36246e690ce79840e69494b 2023-02-13 21:55:06,368 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b02443c56caa48fd8bb5a557ef19ee8b of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,373 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 61d8e8bef76c419fab8637c3de49c780 of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,373 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d3eae3ec5128470586be54dbab8bee54 of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,373 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7618299f867a42c88d29e7a8a3b4e6ac of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,375 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 190caa27a7ab47549ad5840441ce62bf of snapshot=snaptb-1676325289936 to region=9c23d853d6e8509399ae6cfe49244a13 table=testCompactionWithHFileLink 2023-02-13 21:55:06,375 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 688fd3f0ca0f437daad29bd0105df18b of snapshot=snaptb-1676325289936 to region=109ab107cd1296e4625f25be450d7a0f table=testCompactionWithHFileLink 2023-02-13 21:55:06,376 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32be0ede88ca4990a4d68b0d9d7f2b17 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,378 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e6ed3032e9324cb89b91b0f867db5074 of snapshot=snaptb-1676325289936 to region=bf66996b85c4bd7a85bdcb1ce93ad32b table=testCompactionWithHFileLink 2023-02-13 21:55:06,380 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676325289936" table: "testCompactionWithHFileLink" creation_time: 1676325289945 type: FLUSH version: 2 ttl: 0 2023-02-13 21:55:06,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676325306380"}]},"ts":"9223372036854775807"} 2023-02-13 21:55:06,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676325306380"}]},"ts":"9223372036854775807"} 2023-02-13 21:55:06,381 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676325306380"}]},"ts":"9223372036854775807"} 2023-02-13 21:55:06,382 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-13 21:55:06,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 109ab107cd1296e4625f25be450d7a0f, NAME => 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 9c23d853d6e8509399ae6cfe49244a13, NAME => 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => bf66996b85c4bd7a85bdcb1ce93ad32b, NAME => 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 21:55:06,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325306381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325306381"}]},"ts":"1676325306381"} 2023-02-13 21:55:06,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325306381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325306381"}]},"ts":"1676325306381"} 2023-02-13 21:55:06,382 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325306381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325306381"}]},"ts":"1676325306381"} 2023-02-13 21:55:06,384 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 21:55:06,384 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-13 21:55:06,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 109ab107cd1296e4625f25be450d7a0f, NAME => 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 9c23d853d6e8509399ae6cfe49244a13, NAME => 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => bf66996b85c4bd7a85bdcb1ce93ad32b, NAME => 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.', STARTKEY => '', ENDKEY => '1'}] 2023-02-13 21:55:06,384 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676325289936 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-13 21:55:06,386 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676325289936" table: "testCompactionWithHFileLink" creation_time: 1676325289945 type: FLUSH version: 2 ttl: 0 ) in 549 msec 2023-02-13 21:55:06,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-13 21:55:06,450 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-13 21:55:06,450 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:06,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1676325289936-1676325303675" 2023-02-13 21:55:06,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676325289936-1676325303675 2023-02-13 21:55:06,457 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-13 21:55:06,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$10(2372): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-02-13 21:55:06,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-13 21:55:06,467 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-13 21:55:06,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 21:55:06,468 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325306468"}]},"ts":"1676325306468"} 2023-02-13 21:55:06,468 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-13 21:55:06,470 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-13 21:55:06,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN}] 2023-02-13 21:55:06,471 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN 2023-02-13 21:55:06,471 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN 2023-02-13 21:55:06,472 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN 2023-02-13 21:55:06,472 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 21:55:06,472 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 21:55:06,472 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-13 21:55:06,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 21:55:06,624 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:06,624 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:06,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:06,624 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325306624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325306624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325306624"}]},"ts":"1676325306624"} 2023-02-13 21:55:06,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325306624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325306624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325306624"}]},"ts":"1676325306624"} 2023-02-13 21:55:06,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325306624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325306624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325306624"}]},"ts":"1676325306624"} 2023-02-13 21:55:06,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:06,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:06,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:06,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 21:55:06,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:06,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c23d853d6e8509399ae6cfe49244a13, NAME => 'testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 21:55:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,785 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,787 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:06,787 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:06,788 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c23d853d6e8509399ae6cfe49244a13 columnFamilyName family1 2023-02-13 21:55:06,805 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd 2023-02-13 21:55:06,811 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf 2023-02-13 21:55:06,817 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec 2023-02-13 21:55:06,824 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb 2023-02-13 21:55:06,825 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(310): Store=9c23d853d6e8509399ae6cfe49244a13/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:06,825 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,826 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2 2023-02-13 21:55:06,826 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2 2023-02-13 21:55:06,827 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c23d853d6e8509399ae6cfe49244a13 columnFamilyName family2 2023-02-13 21:55:06,837 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf 2023-02-13 21:55:06,844 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780 2023-02-13 21:55:06,856 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5 2023-02-13 21:55:06,865 DEBUG [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040 2023-02-13 21:55:06,866 INFO [StoreOpener-9c23d853d6e8509399ae6cfe49244a13-1] regionserver.HStore(310): Store=9c23d853d6e8509399ae6cfe49244a13/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:06,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:06,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:06,872 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9c23d853d6e8509399ae6cfe49244a13; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64335073, jitterRate=-0.041332706809043884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:06,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9c23d853d6e8509399ae6cfe49244a13: Running coprocessor pre-open hook at 1676325306783Writing region info on filesystem at 1676325306783Initializing all the Stores at 1676325306785 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325306785Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325306785Cleaning up temporary data from old regions at 1676325306869 (+84 ms)Cleaning up detritus from prior splits at 1676325306869Running coprocessor post-open hooks at 1676325306872 (+3 ms)Region opened successfully at 1676325306872 2023-02-13 21:55:06,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., pid=101, masterSystemTime=1676325306777 2023-02-13 21:55:06,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:06,873 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 21:55:06,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 21:55:06,873 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:06,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:06,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:06,876 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9c23d853d6e8509399ae6cfe49244a13, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf66996b85c4bd7a85bdcb1ce93ad32b, NAME => 'testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 21:55:06,876 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325306876"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325306876"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325306876"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325306876"}]},"ts":"1676325306876"} 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:06,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:06,876 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 21:55:06,877 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1912): 9c23d853d6e8509399ae6cfe49244a13/family2 is initiating minor compaction (all files) 2023-02-13 21:55:06,877 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 9c23d853d6e8509399ae6cfe49244a13/family2 in testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:06,877 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp, totalSize=20.4 K 2023-02-13 21:55:06,877 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 21:55:06,877 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1912): 9c23d853d6e8509399ae6cfe49244a13/family1 is initiating minor compaction (all files) 2023-02-13 21:55:06,877 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9c23d853d6e8509399ae6cfe49244a13/family1 in testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:06,877 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp, totalSize=21.6 K 2023-02-13 21:55:06,878 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283851 2023-02-13 21:55:06,878 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283851 2023-02-13 21:55:06,878 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:06,879 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:06,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-13 21:55:06,879 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:06,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 9c23d853d6e8509399ae6cfe49244a13, server=jenkins-hbase20.apache.org,34815,1676325186101 in 252 msec 2023-02-13 21:55:06,879 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:06,880 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:06,880 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:06,880 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:06,880 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:06,880 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9c23d853d6e8509399ae6cfe49244a13, ASSIGN in 409 msec 2023-02-13 21:55:06,881 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:06,881 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf66996b85c4bd7a85bdcb1ce93ad32b columnFamilyName family1 2023-02-13 21:55:06,923 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7 2023-02-13 21:55:06,963 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3 2023-02-13 21:55:06,963 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9c23d853d6e8509399ae6cfe49244a13#family1#compaction#114 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:55:06,983 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] throttle.PressureAwareThroughputController(145): 9c23d853d6e8509399ae6cfe49244a13#family2#compaction#115 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 76.92 MB/second 2023-02-13 21:55:06,993 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990 2023-02-13 21:55:07,014 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085 2023-02-13 21:55:07,022 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(310): Store=bf66996b85c4bd7a85bdcb1ce93ad32b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:07,022 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:07,027 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2 2023-02-13 21:55:07,027 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2 2023-02-13 21:55:07,027 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf66996b85c4bd7a85bdcb1ce93ad32b columnFamilyName family2 2023-02-13 21:55:07,048 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17 2023-02-13 21:55:07,055 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac 2023-02-13 21:55:07,066 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b 2023-02-13 21:55:07,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 21:55:07,074 DEBUG [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074 2023-02-13 21:55:07,074 INFO [StoreOpener-bf66996b85c4bd7a85bdcb1ce93ad32b-1] regionserver.HStore(310): Store=bf66996b85c4bd7a85bdcb1ce93ad32b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:07,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:07,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:07,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:07,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:07,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bf66996b85c4bd7a85bdcb1ce93ad32b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61534444, jitterRate=-0.08306533098220825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:07,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bf66996b85c4bd7a85bdcb1ce93ad32b: Running coprocessor pre-open hook at 1676325306876Writing region info on filesystem at 1676325306876Initializing all the Stores at 1676325306878 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325306878Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325306878Cleaning up temporary data from old regions at 1676325307077 (+199 ms)Cleaning up detritus from prior splits at 1676325307077Running coprocessor post-open hooks at 1676325307080 (+3 ms)Region opened successfully at 1676325307080 2023-02-13 21:55:07,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., pid=102, masterSystemTime=1676325306777 2023-02-13 21:55:07,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 21:55:07,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-13 21:55:07,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:07,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:07,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:07,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 109ab107cd1296e4625f25be450d7a0f, NAME => 'testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 21:55:07,082 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=bf66996b85c4bd7a85bdcb1ce93ad32b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:07,082 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325307082"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325307082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325307082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325307082"}]},"ts":"1676325307082"} 2023-02-13 21:55:07,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:07,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-02-13 21:55:07,085 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure bf66996b85c4bd7a85bdcb1ce93ad32b, server=jenkins-hbase20.apache.org,34815,1676325186101 in 458 msec 2023-02-13 21:55:07,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=bf66996b85c4bd7a85bdcb1ce93ad32b, ASSIGN in 615 msec 2023-02-13 21:55:07,086 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,087 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:07,087 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:07,087 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 109ab107cd1296e4625f25be450d7a0f columnFamilyName family1 2023-02-13 21:55:07,096 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9 2023-02-13 21:55:07,101 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587 2023-02-13 21:55:07,120 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705 2023-02-13 21:55:07,132 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03 2023-02-13 21:55:07,133 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(310): Store=109ab107cd1296e4625f25be450d7a0f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:07,133 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,134 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2 2023-02-13 21:55:07,134 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2 2023-02-13 21:55:07,134 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 109ab107cd1296e4625f25be450d7a0f columnFamilyName family2 2023-02-13 21:55:07,142 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b 2023-02-13 21:55:07,149 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601 2023-02-13 21:55:07,156 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54 2023-02-13 21:55:07,162 DEBUG [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087 2023-02-13 21:55:07,162 INFO [StoreOpener-109ab107cd1296e4625f25be450d7a0f-1] regionserver.HStore(310): Store=109ab107cd1296e4625f25be450d7a0f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:07,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:07,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:07,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 109ab107cd1296e4625f25be450d7a0f; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72447122, jitterRate=0.0795462429523468}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:07,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 109ab107cd1296e4625f25be450d7a0f: Running coprocessor pre-open hook at 1676325307083Writing region info on filesystem at 1676325307083Initializing all the Stores at 1676325307084 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325307084Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325307086 (+2 ms)Cleaning up temporary data from old regions at 1676325307164 (+78 ms)Cleaning up detritus from prior splits at 1676325307164Running coprocessor post-open hooks at 1676325307166 (+2 ms)Region opened successfully at 1676325307166 2023-02-13 21:55:07,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., pid=103, masterSystemTime=1676325306777 2023-02-13 21:55:07,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 21:55:07,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 21:55:07,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:07,167 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:07,168 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=109ab107cd1296e4625f25be450d7a0f, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:07,168 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676325307168"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325307168"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325307168"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325307168"}]},"ts":"1676325307168"} 2023-02-13 21:55:07,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-02-13 21:55:07,171 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 109ab107cd1296e4625f25be450d7a0f, server=jenkins-hbase20.apache.org,34815,1676325186101 in 543 msec 2023-02-13 21:55:07,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-13 21:55:07,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=109ab107cd1296e4625f25be450d7a0f, ASSIGN in 701 msec 2023-02-13 21:55:07,172 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325307172"}]},"ts":"1676325307172"} 2023-02-13 21:55:07,173 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-13 21:55:07,174 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-13 21:55:07,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 713 msec 2023-02-13 21:55:07,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-13 21:55:07,576 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-13 21:55:07,599 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:07,611 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:07,618 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:07,619 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:07,626 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:55:07,640 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-13 21:55:07,641 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:07,641 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(139): Connect 0x1944ef05 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:07,644 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dc2ec34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:07,644 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:07,644 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:07,644 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:07,709 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021336158fc607294d49b7a6d7d9b28d5e07 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023021336158fc607294d49b7a6d7d9b28d5e07 2023-02-13 21:55:07,709 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:07,724 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:07,727 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:07,733 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:55:07,737 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58306, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:55:07,746 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-13 21:55:07,747 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293}] 2023-02-13 21:55:07,753 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 for inclusion in 109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:07,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-13 21:55:07,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 21:55:07,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:55:07,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__7s3cnkqcjtss7d8haf2hg5ck8b7gan9pn9hl7c8p7sncttf46so98hnuier3sk1d/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 2023-02-13 21:55:07,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__7s3cnkqcjtss7d8haf2hg5ck8b7gan9pn9hl7c8p7sncttf46so98hnuier3sk1d/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_ 2023-02-13 21:55:07,759 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__7s3cnkqcjtss7d8haf2hg5ck8b7gan9pn9hl7c8p7sncttf46so98hnuier3sk1d/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 into 109ab107cd1296e4625f25be450d7a0f/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_ - updating store file list. 2023-02-13 21:55:07,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_ into 109ab107cd1296e4625f25be450d7a0f/family1 2023-02-13 21:55:07,763 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__7s3cnkqcjtss7d8haf2hg5ck8b7gan9pn9hl7c8p7sncttf46so98hnuier3sk1d/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 into 109ab107cd1296e4625f25be450d7a0f/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_) 2023-02-13 21:55:07,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__7s3cnkqcjtss7d8haf2hg5ck8b7gan9pn9hl7c8p7sncttf46so98hnuier3sk1d/family1/2d2e3ff4c3fe4ecfbc0bd535f5967293 2023-02-13 21:55:07,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:07,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 21:55:07,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(1912): 109ab107cd1296e4625f25be450d7a0f/family1 is initiating minor compaction (all files) 2023-02-13 21:55:07,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@208ae990; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 21:55:07,768 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:07,768 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:07,770 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023021343655952767442bdb9017ae9fcd7507f 2023-02-13 21:55:07,771 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213724f8853200b42d29f7356e39e70b63b 2023-02-13 21:55:07,772 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302138d04a4838d5e4dd0a8b1df0ca99cd2be 2023-02-13 21:55:07,773 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230213998ceb9e9fc84c57b0c4b2f86b36e22e 2023-02-13 21:55:07,773 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:07,773 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 21:55:07,773 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:07,848 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family1/d17fc290cffb4c5ab8b8172a8f913112 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/d17fc290cffb4c5ab8b8172a8f913112 2023-02-13 21:55:07,852 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/.tmp/family2/9ef087df7a374faea4af0574eb276477 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/9ef087df7a374faea4af0574eb276477 2023-02-13 21:55:07,852 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9c23d853d6e8509399ae6cfe49244a13/family1 of 9c23d853d6e8509399ae6cfe49244a13 into d17fc290cffb4c5ab8b8172a8f913112(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:07,852 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:55:07,852 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., storeName=9c23d853d6e8509399ae6cfe49244a13/family1, priority=12, startTime=1676325306873; duration=0sec 2023-02-13 21:55:07,852 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-02-13 21:55:07,852 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 109ab107cd1296e4625f25be450d7a0f/family1 in testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:07,852 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp, totalSize=28.9 K 2023-02-13 21:55:07,853 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283853 2023-02-13 21:55:07,853 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285666 2023-02-13 21:55:07,854 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:07,854 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288126 2023-02-13 21:55:07,854 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting ed57619b691345f58ad52b65df38e447_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676325283853 2023-02-13 21:55:07,857 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9c23d853d6e8509399ae6cfe49244a13/family2 of 9c23d853d6e8509399ae6cfe49244a13 into 9ef087df7a374faea4af0574eb276477(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:07,857 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:55:07,857 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., storeName=9c23d853d6e8509399ae6cfe49244a13/family2, priority=12, startTime=1676325306873; duration=0sec 2023-02-13 21:55:07,857 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 21:55:07,858 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 21:55:07,865 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 21:55:07,865 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1912): bf66996b85c4bd7a85bdcb1ce93ad32b/family2 is initiating minor compaction (all files) 2023-02-13 21:55:07,865 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2258): Starting compaction of bf66996b85c4bd7a85bdcb1ce93ad32b/family2 in testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:07,865 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp, totalSize=20.4 K 2023-02-13 21:55:07,869 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283850 2023-02-13 21:55:07,871 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:07,871 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:07,872 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:07,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb] to archive 2023-02-13 21:55:07,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:07,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-583ba0fa1d724985976b5cd1dfe629ec 2023-02-13 21:55:07,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-0fb39a61ceea4589916a60005a6171bd 2023-02-13 21:55:07,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-34a7a804b3d340c4a06ca4ea911ea4cf 2023-02-13 21:55:07,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-a6916e0c8dc1406d95b149a52cac48bb 2023-02-13 21:55:07,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf] to archive 2023-02-13 21:55:07,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:07,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-b2012d4e661e4175908658921dd89040 2023-02-13 21:55:07,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-935db34723c8408484efdfc82635b4a5 2023-02-13 21:55:07,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-61d8e8bef76c419fab8637c3de49c780 2023-02-13 21:55:07,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family2/testCompactionWithHFileLink=9c23d853d6e8509399ae6cfe49244a13-190caa27a7ab47549ad5840441ce62bf 2023-02-13 21:55:07,917 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 109ab107cd1296e4625f25be450d7a0f#family1#compaction#116 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:07,921 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] throttle.PressureAwareThroughputController(145): bf66996b85c4bd7a85bdcb1ce93ad32b#family2#compaction#117 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:08,104 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302133441ed2d06d74563855752424338c34f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302133441ed2d06d74563855752424338c34f 2023-02-13 21:55:08,105 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:08,131 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e3a50ee406e74edab93ee4946344ad0a first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-13 21:55:08,132 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e3a50ee406e74edab93ee4946344ad0a}] 2023-02-13 21:55:08,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e3a50ee406e74edab93ee4946344ad0a for inclusion in 9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:08,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-13 21:55:08,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 21:55:08,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 9c23d853d6e8509399ae6cfe49244a13: 2023-02-13 21:55:08,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213/family1/e3a50ee406e74edab93ee4946344ad0a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__lfvuppba1a7gfbbp6kg3qlp5aqbvajv5aph48d6gsses70qdlt2bpnibbddclm0r/family1/e3a50ee406e74edab93ee4946344ad0a 2023-02-13 21:55:08,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__lfvuppba1a7gfbbp6kg3qlp5aqbvajv5aph48d6gsses70qdlt2bpnibbddclm0r/family1/e3a50ee406e74edab93ee4946344ad0a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f286edf154044266ad438abbd840ba18_SeqId_36_ 2023-02-13 21:55:08,141 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__lfvuppba1a7gfbbp6kg3qlp5aqbvajv5aph48d6gsses70qdlt2bpnibbddclm0r/family1/e3a50ee406e74edab93ee4946344ad0a into 9c23d853d6e8509399ae6cfe49244a13/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f286edf154044266ad438abbd840ba18_SeqId_36_ - updating store file list. 2023-02-13 21:55:08,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f286edf154044266ad438abbd840ba18_SeqId_36_ into 9c23d853d6e8509399ae6cfe49244a13/family1 2023-02-13 21:55:08,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__lfvuppba1a7gfbbp6kg3qlp5aqbvajv5aph48d6gsses70qdlt2bpnibbddclm0r/family1/e3a50ee406e74edab93ee4946344ad0a into 9c23d853d6e8509399ae6cfe49244a13/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/family1/f286edf154044266ad438abbd840ba18_SeqId_36_) 2023-02-13 21:55:08,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__lfvuppba1a7gfbbp6kg3qlp5aqbvajv5aph48d6gsses70qdlt2bpnibbddclm0r/family1/e3a50ee406e74edab93ee4946344ad0a 2023-02-13 21:55:08,146 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:08,147 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:08,148 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302130aa03fc310954d5399d39dc214d5c9f4 2023-02-13 21:55:08,149 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302136b17d90da86d4b019154d372ec1030ac 2023-02-13 21:55:08,150 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213a8bfd7480b3d434cac88e08405232720 2023-02-13 21:55:08,151 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230213b2190df9cdb642149f3e78e76448ca62 2023-02-13 21:55:08,151 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:08,151 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 21:55:08,151 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:08,508 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213bf9001eb28cb4477847e74daae256285 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230213bf9001eb28cb4477847e74daae256285 2023-02-13 21:55:08,510 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:08,537 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/04f6a36c556d4b1f99e3c6f768414538 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-13 21:55:08,538 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/04f6a36c556d4b1f99e3c6f768414538}] 2023-02-13 21:55:08,540 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/04f6a36c556d4b1f99e3c6f768414538 for inclusion in bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-13 21:55:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 21:55:08,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:08,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213/family1/04f6a36c556d4b1f99e3c6f768414538 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__nhk6qj6fhr9sukko9djamhof3ka181piigmu2nj43khdmn9890qcuoq2itudolf9/family1/04f6a36c556d4b1f99e3c6f768414538 2023-02-13 21:55:08,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__nhk6qj6fhr9sukko9djamhof3ka181piigmu2nj43khdmn9890qcuoq2itudolf9/family1/04f6a36c556d4b1f99e3c6f768414538 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_ 2023-02-13 21:55:08,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__nhk6qj6fhr9sukko9djamhof3ka181piigmu2nj43khdmn9890qcuoq2itudolf9/family1/04f6a36c556d4b1f99e3c6f768414538 into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_ - updating store file list. 2023-02-13 21:55:08,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_ into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 2023-02-13 21:55:08,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__nhk6qj6fhr9sukko9djamhof3ka181piigmu2nj43khdmn9890qcuoq2itudolf9/family1/04f6a36c556d4b1f99e3c6f768414538 into bf66996b85c4bd7a85bdcb1ce93ad32b/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_) 2023-02-13 21:55:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testCompactionWithHFileLink__nhk6qj6fhr9sukko9djamhof3ka181piigmu2nj43khdmn9890qcuoq2itudolf9/family1/04f6a36c556d4b1f99e3c6f768414538 2023-02-13 21:55:08,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:08,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-13 21:55:08,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(1912): bf66996b85c4bd7a85bdcb1ce93ad32b/family1 is initiating minor compaction (all files) 2023-02-13 21:55:08,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7a75ad87; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 21:55:08,553 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:08,553 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:08,554 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021304af599d474848e9b021d8e438389129 2023-02-13 21:55:08,555 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302132364e7395b4a4ad28be930616c287fab 2023-02-13 21:55:08,556 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213980ca55e1d7648a28bf5afc7a9e44ab1 2023-02-13 21:55:08,557 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230213c1f3b59d9604490aa7360fb64c54d5e9 2023-02-13 21:55:08,557 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-13 21:55:08,557 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 21:55:08,557 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testCompactionWithHFileLink' and column='family1' 2023-02-13 21:55:08,557 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-13 21:55:08,560 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:08,564 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:08,567 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:08,568 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:08,574 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:08,575 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:08,590 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=280 (was 256) - Thread LEAK? -, OpenFileDescriptor=725 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=294 (was 323), ProcessCount=165 (was 165), AvailableMemoryMB=6527 (was 7295) 2023-02-13 21:55:08,603 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=280, OpenFileDescriptor=725, MaxFileDescriptor=60000, SystemLoadAverage=294, ProcessCount=165, AvailableMemoryMB=6527 2023-02-13 21:55:08,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$15(2997): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-02-13 21:55:08,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-13 21:55:08,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 21:55:08,617 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 21:55:08,620 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-02-13 21:55:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-13 21:55:08,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 21:55:08,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-13 21:55:08,728 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:55:08,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-13 21:55:08,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:55:08,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:08,732 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:08,732 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:08,732 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8 empty. 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86 empty. 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b empty. 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:08,733 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:08,733 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-13 21:55:08,769 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family2/203bda7a524c409d9653f4a34710df15 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/203bda7a524c409d9653f4a34710df15 2023-02-13 21:55:08,779 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in bf66996b85c4bd7a85bdcb1ce93ad32b/family2 of bf66996b85c4bd7a85bdcb1ce93ad32b into 203bda7a524c409d9653f4a34710df15(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:08,779 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:08,779 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., storeName=bf66996b85c4bd7a85bdcb1ce93ad32b/family2, priority=12, startTime=1676325307081; duration=0sec 2023-02-13 21:55:08,779 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-13 21:55:08,779 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2258): Starting compaction of bf66996b85c4bd7a85bdcb1ce93ad32b/family1 in testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:08,779 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp, totalSize=28.9 K 2023-02-13 21:55:08,780 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283850 2023-02-13 21:55:08,781 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285665 2023-02-13 21:55:08,782 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:08,782 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288125 2023-02-13 21:55:08,783 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.Compactor(207): Compacting 67fbfb17aee443a4adb96913352e1ede_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676325283850 2023-02-13 21:55:08,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074] to archive 2023-02-13 21:55:08,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:08,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-b02443c56caa48fd8bb5a557ef19ee8b 2023-02-13 21:55:08,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-7618299f867a42c88d29e7a8a3b4e6ac 2023-02-13 21:55:08,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-32be0ede88ca4990a4d68b0d9d7f2b17 2023-02-13 21:55:08,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family2/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-e6ed3032e9324cb89b91b0f867db5074 2023-02-13 21:55:08,798 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] throttle.PressureAwareThroughputController(145): bf66996b85c4bd7a85bdcb1ce93ad32b#family1#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:08,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:09,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:09,061 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:55:09,141 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-13 21:55:09,142 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3fa3f38521a8386caacc176badb612e8, NAME => 'ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:09,142 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => d5c1f8347d893cba27663b71b9d83b3b, NAME => 'ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:09,143 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1d2600283ccd85bf4cfbfc3713f90a86, NAME => 'ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:09,152 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,152 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing d5c1f8347d893cba27663b71b9d83b3b, disabling compactions & flushes 2023-02-13 21:55:09,152 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,152 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,152 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. after waiting 0 ms 2023-02-13 21:55:09,152 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,152 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for d5c1f8347d893cba27663b71b9d83b3b: Waiting for close lock at 1676325309152Disabling compacts and flushes for region at 1676325309152Disabling writes for close at 1676325309152Writing region close event to WAL at 1676325309152Closed at 1676325309152 2023-02-13 21:55:09,153 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family1/e4a3376c36e94e85a2fa7195997fc850 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/e4a3376c36e94e85a2fa7195997fc850 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 1d2600283ccd85bf4cfbfc3713f90a86, disabling compactions & flushes 2023-02-13 21:55:09,153 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. after waiting 0 ms 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,153 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,153 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 1d2600283ccd85bf4cfbfc3713f90a86: Waiting for close lock at 1676325309153Disabling compacts and flushes for region at 1676325309153Disabling writes for close at 1676325309153Writing region close event to WAL at 1676325309153Closed at 1676325309153 2023-02-13 21:55:09,156 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 109ab107cd1296e4625f25be450d7a0f/family1 of 109ab107cd1296e4625f25be450d7a0f into e4a3376c36e94e85a2fa7195997fc850(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:09,156 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:55:09,157 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676325307766; duration=1sec 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. because compaction request was cancelled 2023-02-13 21:55:09,157 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-13 21:55:09,159 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-13 21:55:09,159 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1912): 109ab107cd1296e4625f25be450d7a0f/family2 is initiating minor compaction (all files) 2023-02-13 21:55:09,159 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 109ab107cd1296e4625f25be450d7a0f/family2 in testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:09,159 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp, totalSize=20.4 K 2023-02-13 21:55:09,159 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325283853 2023-02-13 21:55:09,160 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325285666 2023-02-13 21:55:09,160 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325287091 2023-02-13 21:55:09,161 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325288126 2023-02-13 21:55:09,172 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 109ab107cd1296e4625f25be450d7a0f#family2#compaction#119 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:09,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_] to archive 2023-02-13 21:55:09,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:09,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3c93a9c2147141339bdec390d578fca9 2023-02-13 21:55:09,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-3db2e37f21734a4aa451c581a71da587 2023-02-13 21:55:09,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-a0d5f3da63dc444a82863fcacbec8d03 2023-02-13 21:55:09,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-9f89ed04f26e4149bc10cdb3b44e7705 2023-02-13 21:55:09,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family1/ed57619b691345f58ad52b65df38e447_SeqId_34_ 2023-02-13 21:55:09,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 3fa3f38521a8386caacc176badb612e8, disabling compactions & flushes 2023-02-13 21:55:09,558 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. after waiting 0 ms 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,558 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,558 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 3fa3f38521a8386caacc176badb612e8: Waiting for close lock at 1676325309558Disabling compacts and flushes for region at 1676325309558Disabling writes for close at 1676325309558Writing region close event to WAL at 1676325309558Closed at 1676325309558 2023-02-13 21:55:09,560 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:55:09,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325309561"}]},"ts":"1676325309561"} 2023-02-13 21:55:09,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676325309561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325309561"}]},"ts":"1676325309561"} 2023-02-13 21:55:09,561 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325309561"}]},"ts":"1676325309561"} 2023-02-13 21:55:09,563 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 21:55:09,564 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:55:09,564 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325309564"}]},"ts":"1676325309564"} 2023-02-13 21:55:09,565 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-13 21:55:09,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3fa3f38521a8386caacc176badb612e8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d2600283ccd85bf4cfbfc3713f90a86, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5c1f8347d893cba27663b71b9d83b3b, ASSIGN}] 2023-02-13 21:55:09,569 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d2600283ccd85bf4cfbfc3713f90a86, ASSIGN 2023-02-13 21:55:09,569 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5c1f8347d893cba27663b71b9d83b3b, ASSIGN 2023-02-13 21:55:09,569 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3fa3f38521a8386caacc176badb612e8, ASSIGN 2023-02-13 21:55:09,569 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3fa3f38521a8386caacc176badb612e8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:09,569 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5c1f8347d893cba27663b71b9d83b3b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:09,569 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d2600283ccd85bf4cfbfc3713f90a86, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:09,722 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3fa3f38521a8386caacc176badb612e8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,722 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1d2600283ccd85bf4cfbfc3713f90a86, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,722 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d5c1f8347d893cba27663b71b9d83b3b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676325309722"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325309722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325309722"}]},"ts":"1676325309722"} 2023-02-13 21:55:09,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309722"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325309722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325309722"}]},"ts":"1676325309722"} 2023-02-13 21:55:09,722 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309722"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325309722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325309722"}]},"ts":"1676325309722"} 2023-02-13 21:55:09,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 1d2600283ccd85bf4cfbfc3713f90a86, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:09,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 3fa3f38521a8386caacc176badb612e8, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:09,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure d5c1f8347d893cba27663b71b9d83b3b, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:09,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:09,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3fa3f38521a8386caacc176badb612e8, NAME => 'ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 21:55:09,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,884 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,886 DEBUG [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1 2023-02-13 21:55:09,886 DEBUG [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1 2023-02-13 21:55:09,886 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fa3f38521a8386caacc176badb612e8 columnFamilyName family1 2023-02-13 21:55:09,888 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] regionserver.HStore(310): Store=3fa3f38521a8386caacc176badb612e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,888 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,889 DEBUG [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2 2023-02-13 21:55:09,889 DEBUG [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2 2023-02-13 21:55:09,889 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fa3f38521a8386caacc176badb612e8 columnFamilyName family2 2023-02-13 21:55:09,890 INFO [StoreOpener-3fa3f38521a8386caacc176badb612e8-1] regionserver.HStore(310): Store=3fa3f38521a8386caacc176badb612e8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:09,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:09,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:09,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 3fa3f38521a8386caacc176badb612e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70084340, jitterRate=0.04433804750442505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:09,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 3fa3f38521a8386caacc176badb612e8: Running coprocessor pre-open hook at 1676325309882Writing region info on filesystem at 1676325309882Initializing all the Stores at 1676325309884 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309884Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309884Cleaning up temporary data from old regions at 1676325309891 (+7 ms)Cleaning up detritus from prior splits at 1676325309892 (+1 ms)Running coprocessor post-open hooks at 1676325309895 (+3 ms)Region opened successfully at 1676325309895 2023-02-13 21:55:09,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8., pid=110, masterSystemTime=1676325309875 2023-02-13 21:55:09,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:09,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d5c1f8347d893cba27663b71b9d83b3b, NAME => 'ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 21:55:09,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3fa3f38521a8386caacc176badb612e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309897"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325309897"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325309897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325309897"}]},"ts":"1676325309897"} 2023-02-13 21:55:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,898 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-13 21:55:09,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 3fa3f38521a8386caacc176badb612e8, server=jenkins-hbase20.apache.org,34815,1676325186101 in 174 msec 2023-02-13 21:55:09,899 DEBUG [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1 2023-02-13 21:55:09,899 DEBUG [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1 2023-02-13 21:55:09,900 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5c1f8347d893cba27663b71b9d83b3b columnFamilyName family1 2023-02-13 21:55:09,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3fa3f38521a8386caacc176badb612e8, ASSIGN in 332 msec 2023-02-13 21:55:09,900 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] regionserver.HStore(310): Store=d5c1f8347d893cba27663b71b9d83b3b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,901 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,901 DEBUG [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2 2023-02-13 21:55:09,901 DEBUG [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2 2023-02-13 21:55:09,902 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5c1f8347d893cba27663b71b9d83b3b columnFamilyName family2 2023-02-13 21:55:09,902 INFO [StoreOpener-d5c1f8347d893cba27663b71b9d83b3b-1] regionserver.HStore(310): Store=d5c1f8347d893cba27663b71b9d83b3b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:09,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:09,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:09,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d5c1f8347d893cba27663b71b9d83b3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60979118, jitterRate=-0.0913403332233429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:09,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d5c1f8347d893cba27663b71b9d83b3b: Running coprocessor pre-open hook at 1676325309897Writing region info on filesystem at 1676325309897Initializing all the Stores at 1676325309898 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309898Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309898Cleaning up temporary data from old regions at 1676325309904 (+6 ms)Cleaning up detritus from prior splits at 1676325309904Running coprocessor post-open hooks at 1676325309907 (+3 ms)Region opened successfully at 1676325309907 2023-02-13 21:55:09,907 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b., pid=111, masterSystemTime=1676325309875 2023-02-13 21:55:09,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:09,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d2600283ccd85bf4cfbfc3713f90a86, NAME => 'ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 21:55:09,908 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d5c1f8347d893cba27663b71b9d83b3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676325309908"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325309908"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325309908"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325309908"}]},"ts":"1676325309908"} 2023-02-13 21:55:09,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:09,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,910 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-02-13 21:55:09,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure d5c1f8347d893cba27663b71b9d83b3b, server=jenkins-hbase20.apache.org,34815,1676325186101 in 185 msec 2023-02-13 21:55:09,911 DEBUG [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1 2023-02-13 21:55:09,911 DEBUG [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1 2023-02-13 21:55:09,911 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d5c1f8347d893cba27663b71b9d83b3b, ASSIGN in 343 msec 2023-02-13 21:55:09,911 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2600283ccd85bf4cfbfc3713f90a86 columnFamilyName family1 2023-02-13 21:55:09,911 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] regionserver.HStore(310): Store=1d2600283ccd85bf4cfbfc3713f90a86/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,912 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,912 DEBUG [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2 2023-02-13 21:55:09,912 DEBUG [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2 2023-02-13 21:55:09,913 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d2600283ccd85bf4cfbfc3713f90a86 columnFamilyName family2 2023-02-13 21:55:09,913 INFO [StoreOpener-1d2600283ccd85bf4cfbfc3713f90a86-1] regionserver.HStore(310): Store=1d2600283ccd85bf4cfbfc3713f90a86/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:09,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:09,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:09,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:09,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1d2600283ccd85bf4cfbfc3713f90a86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70712899, jitterRate=0.05370430648326874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:09,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1d2600283ccd85bf4cfbfc3713f90a86: Running coprocessor pre-open hook at 1676325309909Writing region info on filesystem at 1676325309909Initializing all the Stores at 1676325309909Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309909Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325309910 (+1 ms)Cleaning up temporary data from old regions at 1676325309914 (+4 ms)Cleaning up detritus from prior splits at 1676325309914Running coprocessor post-open hooks at 1676325309918 (+4 ms)Region opened successfully at 1676325309918 2023-02-13 21:55:09,918 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86., pid=109, masterSystemTime=1676325309875 2023-02-13 21:55:09,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,920 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:09,920 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1d2600283ccd85bf4cfbfc3713f90a86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:09,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676325309920"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325309920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325309920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325309920"}]},"ts":"1676325309920"} 2023-02-13 21:55:09,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-02-13 21:55:09,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 1d2600283ccd85bf4cfbfc3713f90a86, server=jenkins-hbase20.apache.org,34815,1676325186101 in 198 msec 2023-02-13 21:55:09,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-02-13 21:55:09,924 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1d2600283ccd85bf4cfbfc3713f90a86, ASSIGN in 355 msec 2023-02-13 21:55:09,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:55:09,924 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325309924"}]},"ts":"1676325309924"} 2023-02-13 21:55:09,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-13 21:55:09,927 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:55:09,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2050 sec 2023-02-13 21:55:10,024 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/.tmp/family1/ed7ec4550f5542669a670b710241c778 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/ed7ec4550f5542669a670b710241c778 2023-02-13 21:55:10,031 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in bf66996b85c4bd7a85bdcb1ce93ad32b/family1 of bf66996b85c4bd7a85bdcb1ce93ad32b into ed7ec4550f5542669a670b710241c778(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:10,031 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for bf66996b85c4bd7a85bdcb1ce93ad32b: 2023-02-13 21:55:10,031 INFO [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676325308551; duration=1sec 2023-02-13 21:55:10,031 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-13 21:55:10,031 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-13 21:55:10,032 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-13 21:55:10,032 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-13 21:55:10,032 DEBUG [RS:0;jenkins-hbase20:34815-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. because compaction request was cancelled 2023-02-13 21:55:10,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_] to archive 2023-02-13 21:55:10,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:10,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-359e2e8f8f69402aacf5b9b912a6b990 2023-02-13 21:55:10,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-1ea6a71c01cc41c5ad65d433478e24a3 2023-02-13 21:55:10,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-17e231f9624a4d2b9da8c2e6f1d510a7 2023-02-13 21:55:10,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/testCompactionWithHFileLink=bf66996b85c4bd7a85bdcb1ce93ad32b-db7bea649afd4b8aaada0e0eca548085 2023-02-13 21:55:10,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/family1/67fbfb17aee443a4adb96913352e1ede_SeqId_34_ 2023-02-13 21:55:10,407 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/.tmp/family2/6e43a5ca36eb4cbb8d048bfffc4bb889 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/6e43a5ca36eb4cbb8d048bfffc4bb889 2023-02-13 21:55:10,413 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 109ab107cd1296e4625f25be450d7a0f/family2 of 109ab107cd1296e4625f25be450d7a0f into 6e43a5ca36eb4cbb8d048bfffc4bb889(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:10,414 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 109ab107cd1296e4625f25be450d7a0f: 2023-02-13 21:55:10,414 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f., storeName=109ab107cd1296e4625f25be450d7a0f/family2, priority=12, startTime=1676325307166; duration=1sec 2023-02-13 21:55:10,414 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:10,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b] to archive 2023-02-13 21:55:10,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:10,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-78a1f3cbb4de4972be1d990392737601 2023-02-13 21:55:10,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-f1404ab101654fbdb73536a1cbb3d087 2023-02-13 21:55:10,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-d3eae3ec5128470586be54dbab8bee54 2023-02-13 21:55:10,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/family2/testCompactionWithHFileLink=109ab107cd1296e4625f25be450d7a0f-688fd3f0ca0f437daad29bd0105df18b 2023-02-13 21:55:10,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-13 21:55:10,839 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-13 21:55:10,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:10,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:10,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:10,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:10,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 21:55:10,856 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 21:55:10,856 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:10,856 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 21:55:10,856 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 21:55:10,857 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:10,857 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:10,859 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:10,859 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:10,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:10,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:10,860 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:10,860 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:10,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:10,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:10,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:10,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 21:55:10,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 21:55:10,863 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 21:55:10,863 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:10,863 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 21:55:10,863 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:10,863 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. started... 2023-02-13 21:55:10,863 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:10,863 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:10,865 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1d2600283ccd85bf4cfbfc3713f90a86 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:10,863 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:10,866 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:10,865 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. started... 2023-02-13 21:55:10,865 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. started... 2023-02-13 21:55:10,866 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3fa3f38521a8386caacc176badb612e8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:10,866 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d5c1f8347d893cba27663b71b9d83b3b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:10,878 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213f86f8c73c40445dda1c67b6e7ceb6a8c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213f86f8c73c40445dda1c67b6e7ceb6a8c 2023-02-13 21:55:10,878 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213807cfb9a41be43d78d528b9c74fbc9c9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213807cfb9a41be43d78d528b9c74fbc9c9 2023-02-13 21:55:11,283 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/831e6c3ce37541228c6e83bea76e9744 2023-02-13 21:55:11,283 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/006011abcb5f499c85601deda19a4fa1 2023-02-13 21:55:11,286 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021311679fcf52ee4e3a915161d25b4caebc to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021311679fcf52ee4e3a915161d25b4caebc 2023-02-13 21:55:11,702 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/dc5a9de7f0a74aa787ada35291070a0c 2023-02-13 21:55:11,713 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302132dc2b4e1d818498a95ca724e3c636be2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302132dc2b4e1d818498a95ca724e3c636be2 2023-02-13 21:55:11,713 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d8eb5daebac94b6fac38918ca14516c5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213d8eb5daebac94b6fac38918ca14516c5 2023-02-13 21:55:12,121 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/2cd79e49d45248758f3537f371dd1fcd 2023-02-13 21:55:12,126 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/56d5f3c02df34ce19128d589d987970d 2023-02-13 21:55:12,132 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/006011abcb5f499c85601deda19a4fa1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1 2023-02-13 21:55:12,133 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213fab7c3bbf885443bbbf625640dba812f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213fab7c3bbf885443bbbf625640dba812f 2023-02-13 21:55:12,133 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/831e6c3ce37541228c6e83bea76e9744 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744 2023-02-13 21:55:12,137 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:55:12,138 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:55:12,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/2cd79e49d45248758f3537f371dd1fcd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd 2023-02-13 21:55:12,138 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/56d5f3c02df34ce19128d589d987970d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d 2023-02-13 21:55:12,142 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:12,142 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:12,143 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1d2600283ccd85bf4cfbfc3713f90a86 in 1278ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:12,143 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3fa3f38521a8386caacc176badb612e8 in 1277ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:12,143 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 21:55:12,143 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-13 21:55:12,144 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:12,144 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:12,144 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:12,144 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:12,144 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:12,144 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:12,538 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/f7cff2c6f4924eb2be7950c86e1f69b9 2023-02-13 21:55:12,549 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/dc5a9de7f0a74aa787ada35291070a0c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c 2023-02-13 21:55:12,555 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c, entries=4, sequenceid=5, filesize=5.4 K 2023-02-13 21:55:12,556 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/f7cff2c6f4924eb2be7950c86e1f69b9 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9 2023-02-13 21:55:12,561 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:12,561 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d5c1f8347d893cba27663b71b9d83b3b in 1695ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:12,562 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:12,562 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:12,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:12,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:12,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 21:55:12,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 21:55:12,563 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,563 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:12,564 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,564 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:12,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 21:55:12,566 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b9ba48d[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:12,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 21:55:12,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,567 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 21:55:12,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 21:55:12,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:12,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:12,568 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 21:55:12,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:12,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 21:55:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:12,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 21:55:12,572 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 21:55:12,572 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:12,572 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:12,572 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 21:55:12,572 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:12,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:12,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:12,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:12,575 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,577 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:12,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:12,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:12,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:12,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:12,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 21:55:12,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:12,579 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,580 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:12,580 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:12,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 21:55:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:12,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:12,680 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:12,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:12,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:12,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:12,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:12,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:12,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:12,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 21:55:12,686 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 21:55:12,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:12,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 21:55:12,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 21:55:12,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:12,687 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,687 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:12,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:12,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:12,688 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:12,688 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:12,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:12,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:12,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 21:55:12,688 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 21:55:12,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 21:55:12,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 21:55:12,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:12,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. started... 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:12,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:12,689 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1d2600283ccd85bf4cfbfc3713f90a86 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:12,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. started... 2023-02-13 21:55:12,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. started... 2023-02-13 21:55:12,689 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d5c1f8347d893cba27663b71b9d83b3b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:12,689 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3fa3f38521a8386caacc176badb612e8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:12,704 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213a10af290b7924b08a908c12a81977074 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213a10af290b7924b08a908c12a81977074 2023-02-13 21:55:12,704 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302139c94469d3de74d878985c0b89f9f9c94 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302139c94469d3de74d878985c0b89f9f9c94 2023-02-13 21:55:13,109 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/1a25f078d7a7403598e6c1c126bc6838 2023-02-13 21:55:13,110 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/a01f0e03f05249e49d56489a48559e89 2023-02-13 21:55:13,113 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213e6730bc46bb44560859c3afdbc86c9b2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213e6730bc46bb44560859c3afdbc86c9b2 2023-02-13 21:55:13,119 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/a2239a03f9c046e99031bd592ca3dc86 2023-02-13 21:55:13,534 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ee4c8a66a665410880086111f8d51418 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230213ee4c8a66a665410880086111f8d51418 2023-02-13 21:55:13,534 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f31308b06a5d4af8b9f6be0ffc389da5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213f31308b06a5d4af8b9f6be0ffc389da5 2023-02-13 21:55:13,535 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213d2a6bef70e954e9b98a841f694fc6025 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213d2a6bef70e954e9b98a841f694fc6025 2023-02-13 21:55:13,941 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/39b4341f79b84d5983322629c4187544 2023-02-13 21:55:13,943 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/f47feb6f298c43ac8ce65067777c8ee3 2023-02-13 21:55:13,944 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/cd5ad113807d448aa0004fc31e757644 2023-02-13 21:55:13,951 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/1a25f078d7a7403598e6c1c126bc6838 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838 2023-02-13 21:55:13,952 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/a2239a03f9c046e99031bd592ca3dc86 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86 2023-02-13 21:55:13,952 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/a01f0e03f05249e49d56489a48559e89 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89 2023-02-13 21:55:13,955 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:55:13,955 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:55:13,955 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86, entries=4, sequenceid=9, filesize=5.4 K 2023-02-13 21:55:13,956 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/39b4341f79b84d5983322629c4187544 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544 2023-02-13 21:55:13,956 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/cd5ad113807d448aa0004fc31e757644 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644 2023-02-13 21:55:13,956 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/f47feb6f298c43ac8ce65067777c8ee3 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3 2023-02-13 21:55:13,959 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:13,960 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:13,960 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:13,960 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3fa3f38521a8386caacc176badb612e8 in 1271ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:13,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:13,960 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:13,960 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:13,961 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d5c1f8347d893cba27663b71b9d83b3b in 1272ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:13,961 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1d2600283ccd85bf4cfbfc3713f90a86 in 1272ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:13,961 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:13,961 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:13,961 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:13,961 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 21:55:13,961 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 21:55:13,963 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,963 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:13,964 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,964 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:13,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:13,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 21:55:13,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1047b8f5[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:13,965 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 21:55:13,965 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,966 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:13,966 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,966 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 21:55:13,966 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:13,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:13,966 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:13,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 21:55:13,968 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 21:55:13,968 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:13,968 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:13,968 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 21:55:13,968 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:13,969 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,969 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:13,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:13,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,969 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:13,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:13,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:13,970 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,971 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:13,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:13,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 21:55:13,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:13,972 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:13,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:13,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:13,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:13,972 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:14,072 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:14,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:14,076 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:14,076 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:14,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:14,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:14,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:14,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 21:55:14,085 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 21:55:14,085 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:14,085 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 21:55:14,085 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 21:55:14,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:14,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:14,087 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:14,087 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:14,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:14,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:14,088 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:14,088 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:14,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:14,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:14,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:14,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:14,089 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 21:55:14,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 21:55:14,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 21:55:14,090 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 21:55:14,090 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:14,090 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 21:55:14,090 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:14,090 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. started... 2023-02-13 21:55:14,090 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:14,090 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. started... 2023-02-13 21:55:14,090 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:14,091 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:14,091 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1d2600283ccd85bf4cfbfc3713f90a86 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:14,090 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:14,091 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d5c1f8347d893cba27663b71b9d83b3b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:14,091 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. started... 2023-02-13 21:55:14,091 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3fa3f38521a8386caacc176badb612e8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:14,518 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021336418288d93d4e4caab9a186cc8804ea to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021336418288d93d4e4caab9a186cc8804ea 2023-02-13 21:55:14,518 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021365850ff3178f450d8270d946758fe15c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021365850ff3178f450d8270d946758fe15c 2023-02-13 21:55:14,520 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213909f2d06eefd44b0b64df6c669293f37 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213909f2d06eefd44b0b64df6c669293f37 2023-02-13 21:55:14,524 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/c90f5226c28f45e8ab1bcfd423417c18 2023-02-13 21:55:14,525 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/be075a8ef41f43ea8687b952fd351f14 2023-02-13 21:55:14,924 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/774395f100aa449ba3228f7225cab435 2023-02-13 21:55:14,946 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021385208fa29fc54b92b404eef3f1519916 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023021385208fa29fc54b92b404eef3f1519916 2023-02-13 21:55:14,946 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021347e61ed108bc4963a171590f4991198a to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021347e61ed108bc4963a171590f4991198a 2023-02-13 21:55:14,947 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302135c313dd48ce0494896b3a4f99ac8dbf7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302135c313dd48ce0494896b3a4f99ac8dbf7 2023-02-13 21:55:15,352 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/4538ecaf6be2435e81166ca106ae411e 2023-02-13 21:55:15,353 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/e90360475a7e400d96b3d1d14af2dfd6 2023-02-13 21:55:15,353 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/77daaf2a72d84f88b141b8ad8693d8f7 2023-02-13 21:55:15,363 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/c90f5226c28f45e8ab1bcfd423417c18 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18 2023-02-13 21:55:15,363 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/774395f100aa449ba3228f7225cab435 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435 2023-02-13 21:55:15,363 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/be075a8ef41f43ea8687b952fd351f14 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14 2023-02-13 21:55:15,366 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:55:15,366 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:55:15,366 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14, entries=4, sequenceid=13, filesize=5.4 K 2023-02-13 21:55:15,367 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/e90360475a7e400d96b3d1d14af2dfd6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6 2023-02-13 21:55:15,367 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/4538ecaf6be2435e81166ca106ae411e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e 2023-02-13 21:55:15,367 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/77daaf2a72d84f88b141b8ad8693d8f7 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7 2023-02-13 21:55:15,371 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:15,371 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:15,371 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:15,372 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1d2600283ccd85bf4cfbfc3713f90a86 in 1282ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:15,372 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3fa3f38521a8386caacc176badb612e8 in 1281ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:15,372 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d5c1f8347d893cba27663b71b9d83b3b in 1281ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:15,372 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 21:55:15,372 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 21:55:15,373 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,373 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:15,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:15,373 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,373 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:15,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 21:55:15,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b7b158d[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:15,374 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 21:55:15,374 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,375 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,375 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 21:55:15,375 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 21:55:15,375 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:15,375 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,375 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:15,376 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,376 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 21:55:15,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:15,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:15,376 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:15,376 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 21:55:15,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:15,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:15,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 21:55:15,378 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 21:55:15,378 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:15,378 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:15,378 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 21:55:15,378 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:15,379 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:15,379 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,379 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:15,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:15,379 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:15,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,381 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:15,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:15,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:15,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:15,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 21:55:15,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:15,382 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,382 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:15,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:15,383 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:15,383 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:15,383 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:15,383 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:15,383 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,384 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:55:15,483 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:15,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:15,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:15,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:15,486 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:15,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:15,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:15,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 21:55:15,491 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 21:55:15,491 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:15,491 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 21:55:15,491 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 21:55:15,491 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,491 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:15,492 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:15,492 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:15,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:15,494 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:15,494 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:15,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:15,494 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:15,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:15,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:15,495 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 21:55:15,495 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 21:55:15,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 21:55:15,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 21:55:15,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:15,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 21:55:15,495 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:15,495 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. started... 2023-02-13 21:55:15,496 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:15,496 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:15,496 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1d2600283ccd85bf4cfbfc3713f90a86 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:15,496 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:15,495 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:15,496 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. started... 2023-02-13 21:55:15,496 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. started... 2023-02-13 21:55:15,496 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3fa3f38521a8386caacc176badb612e8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:15,496 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d5c1f8347d893cba27663b71b9d83b3b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:15,508 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021391a25c960c23468fb5315b111a4f39f5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021391a25c960c23468fb5315b111a4f39f5 2023-02-13 21:55:15,908 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302136d50f7c93ec54eb4af6ff3576f55a5fb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302136d50f7c93ec54eb4af6ff3576f55a5fb 2023-02-13 21:55:15,908 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302130752ca0e68b44fcabb5c0c6cb28edd29 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302130752ca0e68b44fcabb5c0c6cb28edd29 2023-02-13 21:55:15,914 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/3d3e44f29e544d3988feb971b69f25c1 2023-02-13 21:55:16,314 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/ee27deb1e0074f95927efa9b34816a02 2023-02-13 21:55:16,314 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/1d1117a1188c42609858479746ab64c4 2023-02-13 21:55:16,332 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fee5175e5f274ac985f3d21c3cda4956 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213fee5175e5f274ac985f3d21c3cda4956 2023-02-13 21:55:16,742 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c 2023-02-13 21:55:16,750 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021369d37c69f15e486baccfb5400277007c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023021369d37c69f15e486baccfb5400277007c 2023-02-13 21:55:16,750 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213987cce9815b8474599631ef202ca3f7d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213987cce9815b8474599631ef202ca3f7d 2023-02-13 21:55:16,751 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/3d3e44f29e544d3988feb971b69f25c1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1 2023-02-13 21:55:16,755 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:55:16,756 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c 2023-02-13 21:55:16,759 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:16,760 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1d2600283ccd85bf4cfbfc3713f90a86 in 1264ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:16,760 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:16,760 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:16,760 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:17,156 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/4993dea043994cbfabf61e574623c758 2023-02-13 21:55:17,156 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/b05802abf9f140a7bf81fcfdcb39b463 2023-02-13 21:55:17,166 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/ee27deb1e0074f95927efa9b34816a02 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02 2023-02-13 21:55:17,167 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/1d1117a1188c42609858479746ab64c4 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4 2023-02-13 21:55:17,171 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:55:17,171 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4, entries=4, sequenceid=17, filesize=5.4 K 2023-02-13 21:55:17,171 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/4993dea043994cbfabf61e574623c758 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758 2023-02-13 21:55:17,172 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/b05802abf9f140a7bf81fcfdcb39b463 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463 2023-02-13 21:55:17,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:17,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:17,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d5c1f8347d893cba27663b71b9d83b3b in 1680ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:17,176 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:17,176 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:17,177 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3fa3f38521a8386caacc176badb612e8 in 1680ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:17,177 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:17,177 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 21:55:17,177 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 21:55:17,178 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,178 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:17,178 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,178 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:17,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 21:55:17,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b83b6ac[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:17,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 21:55:17,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,180 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 21:55:17,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 21:55:17,180 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:17,180 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,181 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:17,181 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 21:55:17,181 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,181 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:17,181 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 21:55:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:17,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 21:55:17,184 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 21:55:17,184 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:17,184 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:17,184 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 21:55:17,184 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:17,185 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:17,186 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:17,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,188 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:17,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:17,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:17,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:17,189 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:17,189 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 21:55:17,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:17,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:17,190 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,190 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:17,190 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:17,194 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,194 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:17,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,194 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:17,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 21:55:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:17,290 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:17,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:17,306 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:17,312 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:17,318 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:17,319 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:17,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:17,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:17,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-13 21:55:17,350 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-13 21:55:17,350 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:17,350 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-13 21:55:17,350 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-13 21:55:17,350 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,350 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:17,351 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,351 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:17,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:17,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:17,352 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:17,352 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:17,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:17,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:17,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:17,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:17,352 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-13 21:55:17,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-13 21:55:17,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-13 21:55:17,353 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-13 21:55:17,353 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:17,353 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-13 21:55:17,353 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:17,353 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. started... 2023-02-13 21:55:17,353 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:17,353 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1d2600283ccd85bf4cfbfc3713f90a86 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:17,353 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:17,353 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:17,353 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:17,353 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. started... 2023-02-13 21:55:17,354 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. started... 2023-02-13 21:55:17,354 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d5c1f8347d893cba27663b71b9d83b3b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:17,354 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3fa3f38521a8386caacc176badb612e8 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:18,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/23841809a1af4ea2903b2b3feca67e6c 2023-02-13 21:55:18,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/b86be391ab15439e8233254bb6001cd2 2023-02-13 21:55:18,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/9482e6ee67c6479dac9a6e87baa0e1eb 2023-02-13 21:55:18,185 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23841809a1af4ea2903b2b3feca67e6c 2023-02-13 21:55:18,185 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b86be391ab15439e8233254bb6001cd2 2023-02-13 21:55:18,185 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9482e6ee67c6479dac9a6e87baa0e1eb 2023-02-13 21:55:18,597 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/ead50a8b74084f1e8de1fd51ba36eb24 2023-02-13 21:55:18,602 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/504422d8d7764c5584e9dde60c2cd27f 2023-02-13 21:55:18,603 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ead50a8b74084f1e8de1fd51ba36eb24 2023-02-13 21:55:18,604 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/9482e6ee67c6479dac9a6e87baa0e1eb as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb 2023-02-13 21:55:18,605 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 504422d8d7764c5584e9dde60c2cd27f 2023-02-13 21:55:18,606 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/23841809a1af4ea2903b2b3feca67e6c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c 2023-02-13 21:55:18,608 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9482e6ee67c6479dac9a6e87baa0e1eb 2023-02-13 21:55:18,608 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:18,609 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/ead50a8b74084f1e8de1fd51ba36eb24 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24 2023-02-13 21:55:18,610 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23841809a1af4ea2903b2b3feca67e6c 2023-02-13 21:55:18,610 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:18,611 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/504422d8d7764c5584e9dde60c2cd27f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f 2023-02-13 21:55:18,612 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ead50a8b74084f1e8de1fd51ba36eb24 2023-02-13 21:55:18,612 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:18,613 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1d2600283ccd85bf4cfbfc3713f90a86 in 1260ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:18,613 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:18,613 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:18,613 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:18,614 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 504422d8d7764c5584e9dde60c2cd27f 2023-02-13 21:55:18,614 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:18,615 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d5c1f8347d893cba27663b71b9d83b3b in 1261ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:18,615 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:18,615 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:18,615 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:19,003 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/56aeb50c08a8415f9d6a30e225eda393 2023-02-13 21:55:19,011 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56aeb50c08a8415f9d6a30e225eda393 2023-02-13 21:55:19,013 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/b86be391ab15439e8233254bb6001cd2 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2 2023-02-13 21:55:19,021 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b86be391ab15439e8233254bb6001cd2 2023-02-13 21:55:19,021 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2, entries=3, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:19,022 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/56aeb50c08a8415f9d6a30e225eda393 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393 2023-02-13 21:55:19,028 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56aeb50c08a8415f9d6a30e225eda393 2023-02-13 21:55:19,028 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:19,029 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3fa3f38521a8386caacc176badb612e8 in 1675ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:19,029 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:19,029 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:19,029 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:19,029 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:19,029 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,030 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-13 21:55:19,030 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-13 21:55:19,031 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,031 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:19,032 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,032 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:19,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-13 21:55:19,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@373f93d[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:19,034 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-13 21:55:19,034 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,035 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,036 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-13 21:55:19,036 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-13 21:55:19,036 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:19,036 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,036 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:19,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-13 21:55:19,037 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,037 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-13 21:55:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:19,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-13 21:55:19,040 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-13 21:55:19,041 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:19,041 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:19,041 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-13 21:55:19,041 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:19,042 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,042 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,043 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:19,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:19,043 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,045 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:19,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-13 21:55:19,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:19,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:19,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:19,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:19,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-13 21:55:19,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:19,047 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:19,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-13 21:55:19,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-13 21:55:19,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:19,048 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:19,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:19,048 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:19,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:19,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,049 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-13 21:55:19,049 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-13 21:55:19,149 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:19,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:19,151 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:19,151 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 1d2600283ccd85bf4cfbfc3713f90a86/family1 is initiating major compaction (all files) 2023-02-13 21:55:19,152 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:19,152 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:19,154 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 1d2600283ccd85bf4cfbfc3713f90a86/family1 in ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:19,154 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp, totalSize=26.6 K 2023-02-13 21:55:19,155 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 006011abcb5f499c85601deda19a4fa1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310849 2023-02-13 21:55:19,156 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting a2239a03f9c046e99031bd592ca3dc86, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:19,157 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting be075a8ef41f43ea8687b952fd351f14, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314076 2023-02-13 21:55:19,158 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 3d3e44f29e544d3988feb971b69f25c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315485 2023-02-13 21:55:19,159 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 9482e6ee67c6479dac9a6e87baa0e1eb, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:19,175 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 1d2600283ccd85bf4cfbfc3713f90a86#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:19,592 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302137c6d2f9fda0b4041b7c3070f1a775eaa_del 2023-02-13 21:55:19,592 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302137c6d2f9fda0b4041b7c3070f1a775eaa_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302137c6d2f9fda0b4041b7c3070f1a775eaa_del 2023-02-13 21:55:20,016 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d1a4c2540b41c69d8b93ec05158a99 2023-02-13 21:55:20,017 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family1/68d1a4c2540b41c69d8b93ec05158a99 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/68d1a4c2540b41c69d8b93ec05158a99 2023-02-13 21:55:20,022 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 68d1a4c2540b41c69d8b93ec05158a99 2023-02-13 21:55:20,023 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1d2600283ccd85bf4cfbfc3713f90a86/family1 of 1d2600283ccd85bf4cfbfc3713f90a86 into 68d1a4c2540b41c69d8b93ec05158a99(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:20,023 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:20,023 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:20,023 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 1d2600283ccd85bf4cfbfc3713f90a86/family2 is initiating major compaction (all files) 2023-02-13 21:55:20,024 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:20,024 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:20,024 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 1d2600283ccd85bf4cfbfc3713f90a86/family2 in ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:20,024 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp, totalSize=25.3 K 2023-02-13 21:55:20,025 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 2cd79e49d45248758f3537f371dd1fcd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310849 2023-02-13 21:55:20,025 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f47feb6f298c43ac8ce65067777c8ee3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:20,026 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 4538ecaf6be2435e81166ca106ae411e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314076 2023-02-13 21:55:20,026 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting b93e5f85d8c24a93bcb57eaf6e1cd57c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315485 2023-02-13 21:55:20,027 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting ead50a8b74084f1e8de1fd51ba36eb24, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:20,038 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 1d2600283ccd85bf4cfbfc3713f90a86#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:20,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb] to archive 2023-02-13 21:55:20,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:20,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/006011abcb5f499c85601deda19a4fa1 2023-02-13 21:55:20,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/a2239a03f9c046e99031bd592ca3dc86 2023-02-13 21:55:20,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/be075a8ef41f43ea8687b952fd351f14 2023-02-13 21:55:20,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/3d3e44f29e544d3988feb971b69f25c1 2023-02-13 21:55:20,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/9482e6ee67c6479dac9a6e87baa0e1eb 2023-02-13 21:55:20,456 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230213caa05b6dd203458bbb19908f9cd035ae_del 2023-02-13 21:55:20,456 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213caa05b6dd203458bbb19908f9cd035ae_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230213caa05b6dd203458bbb19908f9cd035ae_del 2023-02-13 21:55:21,273 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92e088c7f59a49d39e37125f25b0e74f 2023-02-13 21:55:21,274 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/.tmp/family2/92e088c7f59a49d39e37125f25b0e74f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/92e088c7f59a49d39e37125f25b0e74f 2023-02-13 21:55:21,281 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92e088c7f59a49d39e37125f25b0e74f 2023-02-13 21:55:21,282 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1d2600283ccd85bf4cfbfc3713f90a86/family2 of 1d2600283ccd85bf4cfbfc3713f90a86 into 92e088c7f59a49d39e37125f25b0e74f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:21,282 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:21,282 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:21,282 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): d5c1f8347d893cba27663b71b9d83b3b/family1 is initiating major compaction (all files) 2023-02-13 21:55:21,283 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:21,283 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:21,283 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of d5c1f8347d893cba27663b71b9d83b3b/family1 in ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:21,283 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp, totalSize=26.6 K 2023-02-13 21:55:21,283 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting dc5a9de7f0a74aa787ada35291070a0c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310849 2023-02-13 21:55:21,284 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 1a25f078d7a7403598e6c1c126bc6838, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:21,284 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting c90f5226c28f45e8ab1bcfd423417c18, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314077 2023-02-13 21:55:21,285 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 1d1117a1188c42609858479746ab64c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315486 2023-02-13 21:55:21,285 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 23841809a1af4ea2903b2b3feca67e6c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:21,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24] to archive 2023-02-13 21:55:21,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:21,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/2cd79e49d45248758f3537f371dd1fcd 2023-02-13 21:55:21,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/f47feb6f298c43ac8ce65067777c8ee3 2023-02-13 21:55:21,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/4538ecaf6be2435e81166ca106ae411e 2023-02-13 21:55:21,294 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): d5c1f8347d893cba27663b71b9d83b3b#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:21,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/b93e5f85d8c24a93bcb57eaf6e1cd57c 2023-02-13 21:55:21,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family2/ead50a8b74084f1e8de1fd51ba36eb24 2023-02-13 21:55:21,708 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021308526ba38c814f9abb1082c2a731c49d_del 2023-02-13 21:55:21,708 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021308526ba38c814f9abb1082c2a731c49d_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021308526ba38c814f9abb1082c2a731c49d_del 2023-02-13 21:55:22,525 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35b1c894d9784114828efeac0829df5a 2023-02-13 21:55:22,525 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family1/35b1c894d9784114828efeac0829df5a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/35b1c894d9784114828efeac0829df5a 2023-02-13 21:55:22,528 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35b1c894d9784114828efeac0829df5a 2023-02-13 21:55:22,529 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d5c1f8347d893cba27663b71b9d83b3b/family1 of d5c1f8347d893cba27663b71b9d83b3b into 35b1c894d9784114828efeac0829df5a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:22,529 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:22,529 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:22,529 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): d5c1f8347d893cba27663b71b9d83b3b/family2 is initiating major compaction (all files) 2023-02-13 21:55:22,529 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:22,530 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:22,530 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of d5c1f8347d893cba27663b71b9d83b3b/family2 in ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:22,530 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp, totalSize=25.3 K 2023-02-13 21:55:22,530 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f7cff2c6f4924eb2be7950c86e1f69b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310849 2023-02-13 21:55:22,530 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 39b4341f79b84d5983322629c4187544, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:22,531 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting e90360475a7e400d96b3d1d14af2dfd6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314077 2023-02-13 21:55:22,531 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting b05802abf9f140a7bf81fcfdcb39b463, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315486 2023-02-13 21:55:22,531 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 504422d8d7764c5584e9dde60c2cd27f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:22,539 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): d5c1f8347d893cba27663b71b9d83b3b#family2#compaction#153 average throughput is 1.02 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:22,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c] to archive 2023-02-13 21:55:22,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:22,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/dc5a9de7f0a74aa787ada35291070a0c 2023-02-13 21:55:22,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1a25f078d7a7403598e6c1c126bc6838 2023-02-13 21:55:22,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/c90f5226c28f45e8ab1bcfd423417c18 2023-02-13 21:55:22,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/1d1117a1188c42609858479746ab64c4 2023-02-13 21:55:22,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/23841809a1af4ea2903b2b3feca67e6c 2023-02-13 21:55:22,946 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213bb0bb2e29d4848fabb69c28d5031d44d_del 2023-02-13 21:55:22,946 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213bb0bb2e29d4848fabb69c28d5031d44d_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230213bb0bb2e29d4848fabb69c28d5031d44d_del 2023-02-13 21:55:23,760 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2495886b1874459dbae7fd835382acc6 2023-02-13 21:55:23,761 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/.tmp/family2/2495886b1874459dbae7fd835382acc6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/2495886b1874459dbae7fd835382acc6 2023-02-13 21:55:23,764 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2495886b1874459dbae7fd835382acc6 2023-02-13 21:55:23,765 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d5c1f8347d893cba27663b71b9d83b3b/family2 of d5c1f8347d893cba27663b71b9d83b3b into 2495886b1874459dbae7fd835382acc6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:23,765 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:23,765 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:23,765 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 3fa3f38521a8386caacc176badb612e8/family1 is initiating major compaction (all files) 2023-02-13 21:55:23,765 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:23,765 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:23,765 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 3fa3f38521a8386caacc176badb612e8/family1 in ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:23,765 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp, totalSize=26.6 K 2023-02-13 21:55:23,766 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 831e6c3ce37541228c6e83bea76e9744, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310848 2023-02-13 21:55:23,766 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting a01f0e03f05249e49d56489a48559e89, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:23,766 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 774395f100aa449ba3228f7225cab435, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314076 2023-02-13 21:55:23,767 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting ee27deb1e0074f95927efa9b34816a02, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315485 2023-02-13 21:55:23,767 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting b86be391ab15439e8233254bb6001cd2, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:23,776 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 3fa3f38521a8386caacc176badb612e8#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:23,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f] to archive 2023-02-13 21:55:23,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:23,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/f7cff2c6f4924eb2be7950c86e1f69b9 2023-02-13 21:55:23,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/39b4341f79b84d5983322629c4187544 2023-02-13 21:55:23,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/e90360475a7e400d96b3d1d14af2dfd6 2023-02-13 21:55:23,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/b05802abf9f140a7bf81fcfdcb39b463 2023-02-13 21:55:23,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family2/504422d8d7764c5584e9dde60c2cd27f 2023-02-13 21:55:24,182 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021392938f4e5a8a4046ab5deb3a88ab209d_del 2023-02-13 21:55:24,183 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021392938f4e5a8a4046ab5deb3a88ab209d_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021392938f4e5a8a4046ab5deb3a88ab209d_del 2023-02-13 21:55:24,197 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b35a22a9128464ea93652d10d161b65 2023-02-13 21:55:24,198 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family1/8b35a22a9128464ea93652d10d161b65 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/8b35a22a9128464ea93652d10d161b65 2023-02-13 21:55:24,202 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b35a22a9128464ea93652d10d161b65 2023-02-13 21:55:24,202 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3fa3f38521a8386caacc176badb612e8/family1 of 3fa3f38521a8386caacc176badb612e8 into 8b35a22a9128464ea93652d10d161b65(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:24,203 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:24,203 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:24,203 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 3fa3f38521a8386caacc176badb612e8/family2 is initiating major compaction (all files) 2023-02-13 21:55:24,203 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:24,203 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:24,203 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 3fa3f38521a8386caacc176badb612e8/family2 in ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:24,203 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp, totalSize=25.3 K 2023-02-13 21:55:24,204 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 56d5f3c02df34ce19128d589d987970d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325310848 2023-02-13 21:55:24,204 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting cd5ad113807d448aa0004fc31e757644, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325312682 2023-02-13 21:55:24,205 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 77daaf2a72d84f88b141b8ad8693d8f7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325314076 2023-02-13 21:55:24,205 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 4993dea043994cbfabf61e574623c758, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325315485 2023-02-13 21:55:24,205 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 56aeb50c08a8415f9d6a30e225eda393, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:24,214 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 3fa3f38521a8386caacc176badb612e8#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:24,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2] to archive 2023-02-13 21:55:24,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:24,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/831e6c3ce37541228c6e83bea76e9744 2023-02-13 21:55:24,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/a01f0e03f05249e49d56489a48559e89 2023-02-13 21:55:24,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/774395f100aa449ba3228f7225cab435 2023-02-13 21:55:24,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/ee27deb1e0074f95927efa9b34816a02 2023-02-13 21:55:24,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/b86be391ab15439e8233254bb6001cd2 2023-02-13 21:55:24,625 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302131e34d3b8b23c449884aed4db6b70397b_del 2023-02-13 21:55:24,625 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302131e34d3b8b23c449884aed4db6b70397b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302131e34d3b8b23c449884aed4db6b70397b_del 2023-02-13 21:55:25,439 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65b3a742be6e448eba5d97bbba0c93d2 2023-02-13 21:55:25,440 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/.tmp/family2/65b3a742be6e448eba5d97bbba0c93d2 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/65b3a742be6e448eba5d97bbba0c93d2 2023-02-13 21:55:25,444 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65b3a742be6e448eba5d97bbba0c93d2 2023-02-13 21:55:25,445 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3fa3f38521a8386caacc176badb612e8/family2 of 3fa3f38521a8386caacc176badb612e8 into 65b3a742be6e448eba5d97bbba0c93d2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:25,445 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:25,453 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:25,456 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:25,459 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:25,460 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:25,480 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:55:25,480 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:55:25,480 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1944ef05 to 127.0.0.1:60489 2023-02-13 21:55:25,480 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:25,482 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:55:25,482 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bd70d63 to 127.0.0.1:60489 2023-02-13 21:55:25,482 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:25,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393] to archive 2023-02-13 21:55:25,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:25,497 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-13 21:55:25,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56d5f3c02df34ce19128d589d987970d 2023-02-13 21:55:25,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/cd5ad113807d448aa0004fc31e757644 2023-02-13 21:55:25,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/77daaf2a72d84f88b141b8ad8693d8f7 2023-02-13 21:55:25,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/4993dea043994cbfabf61e574623c758 2023-02-13 21:55:25,501 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021392938f4e5a8a4046ab5deb3a88ab209d_del 2023-02-13 21:55:25,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family2/56aeb50c08a8415f9d6a30e225eda393 2023-02-13 21:55:25,505 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302137c6d2f9fda0b4041b7c3070f1a775eaa_del 2023-02-13 21:55:25,508 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021308526ba38c814f9abb1082c2a731c49d_del 2023-02-13 21:55:25,508 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:25,508 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(139): Connect 0x1c5d989f to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:25,523 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1201e9c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:25,525 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:25,525 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:25,525 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:26,359 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302131ae150e9321f4d61bb5d53e92e1afd9d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302131ae150e9321f4d61bb5d53e92e1afd9d 2023-02-13 21:55:26,359 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021390803782aaca4c1899ba5706ef18e35d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023021390803782aaca4c1899ba5706ef18e35d 2023-02-13 21:55:26,359 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213477345e4c70a4b4cacaa60b869fced08 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213477345e4c70a4b4cacaa60b869fced08 2023-02-13 21:55:26,360 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,360 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,360 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,370 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:26,372 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:26,379 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:55:26,387 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:55:26,423 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9b4ba3c4dafa4523b69fd8830d1f7731 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-13 21:55:26,424 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/fae8da4fac1c4fbfb63848b5f8772eb5 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-13 21:55:26,424 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/bbe3b024d89742c19bef353853237e95 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-13 21:55:26,424 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9b4ba3c4dafa4523b69fd8830d1f7731}] 2023-02-13 21:55:26,425 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/fae8da4fac1c4fbfb63848b5f8772eb5}] 2023-02-13 21:55:26,425 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/bbe3b024d89742c19bef353853237e95}] 2023-02-13 21:55:26,432 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/bbe3b024d89742c19bef353853237e95 for inclusion in 3fa3f38521a8386caacc176badb612e8/family1 2023-02-13 21:55:26,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9b4ba3c4dafa4523b69fd8830d1f7731 for inclusion in d5c1f8347d893cba27663b71b9d83b3b/family1 2023-02-13 21:55:26,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/fae8da4fac1c4fbfb63848b5f8772eb5 for inclusion in 1d2600283ccd85bf4cfbfc3713f90a86/family1 2023-02-13 21:55:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-13 21:55:26,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for d5c1f8347d893cba27663b71b9d83b3b: 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 1d2600283ccd85bf4cfbfc3713f90a86: 2023-02-13 21:55:26,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 3fa3f38521a8386caacc176badb612e8: 2023-02-13 21:55:26,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213/family1/9b4ba3c4dafa4523b69fd8830d1f7731 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__lcj2hi6f1ag7tau1njqe58k3ntprcfup8onrrb3utpnfem6t2o1lrkvhoqb4vb56/family1/9b4ba3c4dafa4523b69fd8830d1f7731 2023-02-13 21:55:26,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213/family1/fae8da4fac1c4fbfb63848b5f8772eb5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__2vm81hspadtjec369ggf51osq6uvdnp76q7lf1m5lkodlbc56ngrcs2vtbdh7mus/family1/fae8da4fac1c4fbfb63848b5f8772eb5 2023-02-13 21:55:26,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213/family1/bbe3b024d89742c19bef353853237e95 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__no8l7gpa2cpp22f3qdqs8knlo1sepgdnoaplvefr842m7kbp803oe7395cmgu0mf/family1/bbe3b024d89742c19bef353853237e95 2023-02-13 21:55:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__2vm81hspadtjec369ggf51osq6uvdnp76q7lf1m5lkodlbc56ngrcs2vtbdh7mus/family1/fae8da4fac1c4fbfb63848b5f8772eb5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/6024af69046b4d9bb2b2ea9f3d8416dd_SeqId_28_ 2023-02-13 21:55:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__lcj2hi6f1ag7tau1njqe58k3ntprcfup8onrrb3utpnfem6t2o1lrkvhoqb4vb56/family1/9b4ba3c4dafa4523b69fd8830d1f7731 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/b0d28256ebee45b48aa6be2cb46b10b1_SeqId_28_ 2023-02-13 21:55:26,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__no8l7gpa2cpp22f3qdqs8knlo1sepgdnoaplvefr842m7kbp803oe7395cmgu0mf/family1/bbe3b024d89742c19bef353853237e95 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/2a8f5c0c1acd4e0cbbb2f4507fadb1d2_SeqId_28_ 2023-02-13 21:55:26,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__2vm81hspadtjec369ggf51osq6uvdnp76q7lf1m5lkodlbc56ngrcs2vtbdh7mus/family1/fae8da4fac1c4fbfb63848b5f8772eb5 into 1d2600283ccd85bf4cfbfc3713f90a86/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/6024af69046b4d9bb2b2ea9f3d8416dd_SeqId_28_ - updating store file list. 2023-02-13 21:55:26,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__lcj2hi6f1ag7tau1njqe58k3ntprcfup8onrrb3utpnfem6t2o1lrkvhoqb4vb56/family1/9b4ba3c4dafa4523b69fd8830d1f7731 into d5c1f8347d893cba27663b71b9d83b3b/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/b0d28256ebee45b48aa6be2cb46b10b1_SeqId_28_ - updating store file list. 2023-02-13 21:55:26,441 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__no8l7gpa2cpp22f3qdqs8knlo1sepgdnoaplvefr842m7kbp803oe7395cmgu0mf/family1/bbe3b024d89742c19bef353853237e95 into 3fa3f38521a8386caacc176badb612e8/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/2a8f5c0c1acd4e0cbbb2f4507fadb1d2_SeqId_28_ - updating store file list. 2023-02-13 21:55:26,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/6024af69046b4d9bb2b2ea9f3d8416dd_SeqId_28_ into 1d2600283ccd85bf4cfbfc3713f90a86/family1 2023-02-13 21:55:26,445 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/2a8f5c0c1acd4e0cbbb2f4507fadb1d2_SeqId_28_ into 3fa3f38521a8386caacc176badb612e8/family1 2023-02-13 21:55:26,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__2vm81hspadtjec369ggf51osq6uvdnp76q7lf1m5lkodlbc56ngrcs2vtbdh7mus/family1/fae8da4fac1c4fbfb63848b5f8772eb5 into 1d2600283ccd85bf4cfbfc3713f90a86/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/family1/6024af69046b4d9bb2b2ea9f3d8416dd_SeqId_28_) 2023-02-13 21:55:26,445 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__no8l7gpa2cpp22f3qdqs8knlo1sepgdnoaplvefr842m7kbp803oe7395cmgu0mf/family1/bbe3b024d89742c19bef353853237e95 into 3fa3f38521a8386caacc176badb612e8/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/family1/2a8f5c0c1acd4e0cbbb2f4507fadb1d2_SeqId_28_) 2023-02-13 21:55:26,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__2vm81hspadtjec369ggf51osq6uvdnp76q7lf1m5lkodlbc56ngrcs2vtbdh7mus/family1/fae8da4fac1c4fbfb63848b5f8772eb5 2023-02-13 21:55:26,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__no8l7gpa2cpp22f3qdqs8knlo1sepgdnoaplvefr842m7kbp803oe7395cmgu0mf/family1/bbe3b024d89742c19bef353853237e95 2023-02-13 21:55:26,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/b0d28256ebee45b48aa6be2cb46b10b1_SeqId_28_ into d5c1f8347d893cba27663b71b9d83b3b/family1 2023-02-13 21:55:26,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__lcj2hi6f1ag7tau1njqe58k3ntprcfup8onrrb3utpnfem6t2o1lrkvhoqb4vb56/family1/9b4ba3c4dafa4523b69fd8830d1f7731 into d5c1f8347d893cba27663b71b9d83b3b/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/family1/b0d28256ebee45b48aa6be2cb46b10b1_SeqId_28_) 2023-02-13 21:55:26,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__ns_testMinorCompaction__lcj2hi6f1ag7tau1njqe58k3ntprcfup8onrrb3utpnfem6t2o1lrkvhoqb4vb56/family1/9b4ba3c4dafa4523b69fd8830d1f7731 2023-02-13 21:55:26,448 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,448 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,448 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,448 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:26,448 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:26,448 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213f86f8c73c40445dda1c67b6e7ceb6a8c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230213f86f8c73c40445dda1c67b6e7ceb6a8c 2023-02-13 21:55:26,450 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213807cfb9a41be43d78d528b9c74fbc9c9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230213807cfb9a41be43d78d528b9c74fbc9c9 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021311679fcf52ee4e3a915161d25b4caebc to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023021311679fcf52ee4e3a915161d25b4caebc 2023-02-13 21:55:26,450 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 21:55:26,450 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:26,450 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-13 21:55:26,450 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 21:55:26,451 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:26,451 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='ns:testMinorCompaction' and column='family1' 2023-02-13 21:55:26,451 INFO [Listener at localhost.localdomain/39503] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-13 21:55:26,453 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:26,455 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:26,458 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:26,459 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:26,475 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 280), OpenFileDescriptor=634 (was 725), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=239 (was 294), ProcessCount=165 (was 165), AvailableMemoryMB=7153 (was 6527) - AvailableMemoryMB LEAK? - 2023-02-13 21:55:26,487 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=239, ProcessCount=165, AvailableMemoryMB=7149 2023-02-13 21:55:26,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-13 21:55:26,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:26,491 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:55:26,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-13 21:55:26,492 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:55:26,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 21:55:26,493 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,493 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22 empty. 2023-02-13 21:55:26,494 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,494 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-13 21:55:26,499 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-13 21:55:26,500 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 04b9f9298378fddd0e87b95e75732d22, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:26,504 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:26,505 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 04b9f9298378fddd0e87b95e75732d22, disabling compactions & flushes 2023-02-13 21:55:26,505 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,505 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,505 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. after waiting 0 ms 2023-02-13 21:55:26,505 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,505 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,505 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 04b9f9298378fddd0e87b95e75732d22: Waiting for close lock at 1676325326504Disabling compacts and flushes for region at 1676325326504Disabling writes for close at 1676325326505 (+1 ms)Writing region close event to WAL at 1676325326505Closed at 1676325326505 2023-02-13 21:55:26,507 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:55:26,507 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325326507"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325326507"}]},"ts":"1676325326507"} 2023-02-13 21:55:26,508 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 21:55:26,509 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:55:26,509 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325326509"}]},"ts":"1676325326509"} 2023-02-13 21:55:26,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-13 21:55:26,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=04b9f9298378fddd0e87b95e75732d22, ASSIGN}] 2023-02-13 21:55:26,513 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=04b9f9298378fddd0e87b95e75732d22, ASSIGN 2023-02-13 21:55:26,514 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=04b9f9298378fddd0e87b95e75732d22, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:26,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 21:55:26,672 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=04b9f9298378fddd0e87b95e75732d22, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:26,672 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325326672"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325326672"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325326672"}]},"ts":"1676325326672"} 2023-02-13 21:55:26,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 04b9f9298378fddd0e87b95e75732d22, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:26,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 21:55:26,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 04b9f9298378fddd0e87b95e75732d22, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.', STARTKEY => '', ENDKEY => ''} 2023-02-13 21:55:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,829 INFO [StoreOpener-04b9f9298378fddd0e87b95e75732d22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,830 DEBUG [StoreOpener-04b9f9298378fddd0e87b95e75732d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:26,830 DEBUG [StoreOpener-04b9f9298378fddd0e87b95e75732d22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:26,830 INFO [StoreOpener-04b9f9298378fddd0e87b95e75732d22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04b9f9298378fddd0e87b95e75732d22 columnFamilyName family1 2023-02-13 21:55:26,831 INFO [StoreOpener-04b9f9298378fddd0e87b95e75732d22-1] regionserver.HStore(310): Store=04b9f9298378fddd0e87b95e75732d22/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:26,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:26,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:26,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 04b9f9298378fddd0e87b95e75732d22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71403131, jitterRate=0.0639895647764206}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 21:55:26,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 04b9f9298378fddd0e87b95e75732d22: Running coprocessor pre-open hook at 1676325326828Writing region info on filesystem at 1676325326828Initializing all the Stores at 1676325326829 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676325326829Cleaning up temporary data from old regions at 1676325326833 (+4 ms)Cleaning up detritus from prior splits at 1676325326833Running coprocessor post-open hooks at 1676325326837 (+4 ms)Region opened successfully at 1676325326837 2023-02-13 21:55:26,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., pid=114, masterSystemTime=1676325326825 2023-02-13 21:55:26,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:26,839 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=04b9f9298378fddd0e87b95e75732d22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:26,839 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676325326839"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325326839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325326839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325326839"}]},"ts":"1676325326839"} 2023-02-13 21:55:26,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-13 21:55:26,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 04b9f9298378fddd0e87b95e75732d22, server=jenkins-hbase20.apache.org,34815,1676325186101 in 167 msec 2023-02-13 21:55:26,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-13 21:55:26,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=04b9f9298378fddd0e87b95e75732d22, ASSIGN in 329 msec 2023-02-13 21:55:26,842 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:55:26,843 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325326843"}]},"ts":"1676325326843"} 2023-02-13 21:55:26,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-13 21:55:26,845 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:55:26,845 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 356 msec 2023-02-13 21:55:27,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-13 21:55:27,096 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-13 21:55:27,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:27,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,120 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:27,120 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:27,120 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:27,120 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:27,121 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,121 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,122 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:27,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:27,122 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:27,122 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,122 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,123 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:27,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:27,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:27,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:27,123 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:27,123 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:27,123 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:27,124 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-13 21:55:27,552 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307a701380cc0d4c9db1ef74d57f428955 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307a701380cc0d4c9db1ef74d57f428955 2023-02-13 21:55:27,956 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/d381528fc8cc4f81b3b50392cbe2374b 2023-02-13 21:55:27,966 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/d381528fc8cc4f81b3b50392cbe2374b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b 2023-02-13 21:55:27,971 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-13 21:55:27,972 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 848ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:27,972 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:27,973 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:27,973 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:27,973 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:27,973 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:27,973 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,973 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:27,973 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:27,974 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,974 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:27,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:27,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,975 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:27,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:27,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:27,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5431929[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:27,976 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:27,976 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,977 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:27,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:27,977 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:27,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,977 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:27,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:27,978 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:27,978 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:27,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:27,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:27,980 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:27,980 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:27,981 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:27,981 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,981 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:27,981 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,981 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:27,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,982 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:27,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:27,982 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,984 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:27,986 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:27,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:27,986 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:27,987 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:27,987 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:27,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:28,087 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:28,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:28,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:28,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:28,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,093 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:28,093 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:28,093 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:28,093 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:28,094 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,094 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,095 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:28,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:28,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:28,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,095 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:28,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:28,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,096 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:28,096 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,096 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:28,096 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:28,096 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:28,096 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:28,096 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:28,096 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:28,096 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:28,096 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-13 21:55:28,113 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281df85fab757b4cc99d98e08578d73179 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281df85fab757b4cc99d98e08578d73179 2023-02-13 21:55:28,518 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/0fd27d0846214a3987bd34716562f210 2023-02-13 21:55:28,522 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/0fd27d0846214a3987bd34716562f210 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210 2023-02-13 21:55:28,525 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210, entries=1, sequenceid=9, filesize=5.0 K 2023-02-13 21:55:28,526 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 430ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:28,526 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:28,526 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:28,526 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:28,526 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:28,526 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,526 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:28,527 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:28,528 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:28,528 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:28,528 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:28,528 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:28,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:28,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:28,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e86d932[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:28,529 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:28,530 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,530 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,531 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,531 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:28,531 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:28,531 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:28,531 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:28,532 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,532 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,532 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:28,532 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:28,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:28,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:28,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:28,535 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:28,535 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:28,535 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:28,535 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,535 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:28,536 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,536 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,536 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:28,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:28,537 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,538 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,541 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:28,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:28,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:28,542 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:28,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,542 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,543 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:28,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:28,642 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:28,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:28,647 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:28,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:28,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,649 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:28,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:28,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:28,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:28,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,650 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,650 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:28,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:28,650 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:28,650 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:28,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:28,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,651 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,651 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:28,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:28,651 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:28,651 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:28,652 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:28,653 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:28,653 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:28,653 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:28,653 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:28,653 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:29,064 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201711be2e675d84e6c816727c7c50378e4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201711be2e675d84e6c816727c7c50378e4 2023-02-13 21:55:29,470 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/09a010bdbf164c129d0b61946279bc2f 2023-02-13 21:55:29,481 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/09a010bdbf164c129d0b61946279bc2f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f 2023-02-13 21:55:29,487 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f, entries=1, sequenceid=13, filesize=4.9 K 2023-02-13 21:55:29,488 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 835ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:29,489 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:29,489 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:29,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:29,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:29,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:29,489 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:29,490 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,490 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:29,491 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,491 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:29,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:29,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:29,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44d5b470[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:29,493 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:29,493 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,494 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,494 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:29,494 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:29,494 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:29,494 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,494 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:29,495 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:29,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:29,495 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:29,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:29,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:29,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:29,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:29,498 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:29,498 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:29,498 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:29,498 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,498 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:29,500 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,500 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:29,500 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:29,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:29,500 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:29,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,502 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:29,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:29,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:29,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:29,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:29,504 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:29,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:29,504 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,604 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:29,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:29,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:29,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:29,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,617 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:29,617 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:29,617 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:29,617 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:29,618 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,618 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,619 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:29,619 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:29,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:29,620 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:29,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,622 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,622 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:29,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:29,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:29,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:29,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:29,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:29,623 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:29,623 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:29,623 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:29,623 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:30,046 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c476ff458dd646358faa8136fe6ddf65 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c476ff458dd646358faa8136fe6ddf65 2023-02-13 21:55:30,455 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/1c6e3ba570cc43c9b24347caba03b962 2023-02-13 21:55:30,459 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/1c6e3ba570cc43c9b24347caba03b962 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962 2023-02-13 21:55:30,463 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962, entries=1, sequenceid=17, filesize=4.9 K 2023-02-13 21:55:30,463 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 840ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:30,464 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:30,464 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:30,464 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:30,464 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:30,464 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,464 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:30,464 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:30,465 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,465 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:30,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:30,466 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,466 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58f317c6[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:30,467 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:30,467 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,467 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,467 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:30,467 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:30,467 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:30,467 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,467 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:30,468 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:30,468 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:30,468 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,468 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:30,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:30,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:30,470 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:30,470 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:30,470 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:30,470 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,470 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:30,471 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:30,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:30,471 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,472 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,473 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,473 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:30,473 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,473 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:30,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:30,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:30,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:30,474 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:30,474 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:30,474 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:30,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:30,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:30,574 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:30,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:30,578 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:30,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:30,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,579 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:30,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:30,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:30,579 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:30,580 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,580 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,581 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:30,581 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:30,581 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:30,581 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:30,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:30,582 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:30,582 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:30,582 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:30,994 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d4345dd889aa425094453a4d8a304201 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4345dd889aa425094453a4d8a304201 2023-02-13 21:55:31,400 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/46deedc123664609b49c55ffacef0a37 2023-02-13 21:55:31,409 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/46deedc123664609b49c55ffacef0a37 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37 2023-02-13 21:55:31,414 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37, entries=1, sequenceid=21, filesize=4.9 K 2023-02-13 21:55:31,415 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 833ms, sequenceid=21, compaction requested=true 2023-02-13 21:55:31,415 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:31,415 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:31,415 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:31,415 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:31,416 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,416 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:31,416 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:31,417 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,417 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:31,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:31,418 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,418 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:31,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:31,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:31,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4564d7a0[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:31,420 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:31,420 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,421 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,421 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:31,421 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:31,422 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:31,422 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,422 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:31,423 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,423 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:31,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:31,423 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:31,423 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:31,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:31,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:31,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:31,427 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:31,427 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:31,427 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:31,427 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,427 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:31,430 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,430 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:31,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,430 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:31,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:31,431 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:31,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,433 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:31,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,443 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:31,443 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:31,444 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:31,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:31,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:31,444 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:31,444 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,444 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:31,444 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:31,445 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:31,444 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:31,445 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,445 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,445 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,545 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:31,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:31,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:31,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,557 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:31,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:31,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:31,557 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:31,558 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,558 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,559 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,559 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:31,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:31,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:31,560 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,560 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:31,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:31,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,561 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:31,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:31,562 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:31,562 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:31,563 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:31,579 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310e215225566c412d9a9686573ddb4990 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310e215225566c412d9a9686573ddb4990 2023-02-13 21:55:31,985 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/4913fb35b0d548a8b2ea583871f40963 2023-02-13 21:55:31,989 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/4913fb35b0d548a8b2ea583871f40963 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963 2023-02-13 21:55:31,993 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963, entries=1, sequenceid=25, filesize=4.9 K 2023-02-13 21:55:31,993 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 430ms, sequenceid=25, compaction requested=true 2023-02-13 21:55:31,994 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:31,994 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:31,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:31,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:31,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:31,994 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:31,995 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,995 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:31,995 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,995 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:31,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:31,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:31,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:31,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d33c977[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:31,998 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:31,998 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,999 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:31,999 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:31,999 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:31,999 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:32,000 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:32,000 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:32,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:32,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:32,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:32,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:32,003 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:32,003 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:32,003 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:32,003 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,004 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:32,005 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,005 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,005 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:32,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:32,005 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:32,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:32,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,007 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:32,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:32,009 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:32,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:32,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:32,009 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:32,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:32,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:32,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:32,009 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,010 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:32,110 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:32,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:32,115 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:32,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:32,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,117 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:32,117 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:32,117 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:32,117 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:32,118 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,118 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,118 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:32,118 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:32,119 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,119 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:32,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,120 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,120 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:32,120 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,120 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:32,120 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:32,120 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:32,120 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:32,120 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:32,120 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:32,120 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:32,120 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:32,364 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:55:32,536 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011624073886274cb2bc7ffc24100428eb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011624073886274cb2bc7ffc24100428eb 2023-02-13 21:55:32,942 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/1dfeb54e730649d8b6c784d17b671fb9 2023-02-13 21:55:32,945 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/1dfeb54e730649d8b6c784d17b671fb9 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9 2023-02-13 21:55:32,948 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9, entries=1, sequenceid=29, filesize=4.9 K 2023-02-13 21:55:32,949 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 829ms, sequenceid=29, compaction requested=true 2023-02-13 21:55:32,949 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:32,949 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:32,949 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:32,949 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:32,949 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,949 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:32,949 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:32,950 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,950 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:32,950 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,950 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:32,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:32,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34ac9095[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:32,951 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:32,951 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,952 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,952 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:32,952 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:32,952 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:32,952 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,952 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:32,953 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:32,953 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,953 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:32,953 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:32,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:32,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:32,955 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:32,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:32,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:32,955 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,955 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:32,956 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,956 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:32,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,956 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:32,956 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:32,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:32,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,957 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:32,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,958 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:32,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,959 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:32,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:32,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:32,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:32,959 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:33,060 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:33,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:33,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:33,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:33,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,071 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:33,071 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:33,071 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:33,071 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:33,072 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,072 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,073 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:33,073 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:33,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:33,073 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,073 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:33,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:33,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,075 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,075 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:33,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:33,075 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:33,075 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:33,075 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:33,076 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:33,493 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ae6e7664da6c427e8afc518691652306 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae6e7664da6c427e8afc518691652306 2023-02-13 21:55:33,502 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/5823102ec3f745b8bcb1aa56cb12c580 2023-02-13 21:55:33,509 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/5823102ec3f745b8bcb1aa56cb12c580 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580 2023-02-13 21:55:33,515 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580, entries=1, sequenceid=33, filesize=4.9 K 2023-02-13 21:55:33,516 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 440ms, sequenceid=33, compaction requested=true 2023-02-13 21:55:33,516 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:33,516 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:33,516 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:33,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:33,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:33,517 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:33,518 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,518 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:33,519 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,519 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:33,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:33,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74a1fce1[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:33,521 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:33,521 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,522 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,522 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:33,522 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:33,522 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,522 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:33,522 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:33,525 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:33,525 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,525 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:33,525 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:33,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:33,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:33,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:33,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:33,529 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:33,529 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:33,529 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:33,529 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,529 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:33,535 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,535 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:33,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,535 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:33,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:33,535 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:33,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,537 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:33,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:33,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,538 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:33,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:33,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:33,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:33,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:33,538 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:33,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:33,539 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,639 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:33,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:33,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:33,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,649 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:33,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:33,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:33,649 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:33,650 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,650 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,651 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:33,651 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:33,651 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:33,651 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:33,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,652 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:33,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,652 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:33,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:33,652 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:33,652 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:33,652 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:33,652 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:33,653 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:33,653 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:33,653 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:33,653 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:33,664 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090731fc99588a554686812ed470308410a4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090731fc99588a554686812ed470308410a4 2023-02-13 21:55:34,069 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/d5a8317d45d6412f92a833fdd360319f 2023-02-13 21:55:34,075 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/d5a8317d45d6412f92a833fdd360319f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f 2023-02-13 21:55:34,080 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f, entries=1, sequenceid=37, filesize=4.9 K 2023-02-13 21:55:34,081 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 428ms, sequenceid=37, compaction requested=true 2023-02-13 21:55:34,081 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:34,081 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:34,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:34,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:34,081 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,082 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:34,082 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:34,083 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,083 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:34,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:34,083 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,083 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:34,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:34,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:34,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@179bfc02[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:34,085 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:34,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,086 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,086 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:34,086 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:34,086 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,087 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:34,086 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:34,088 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,088 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:34,088 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:34,088 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:34,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:34,090 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:34,090 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:34,090 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:34,090 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,090 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:34,091 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,091 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,091 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:34,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:34,092 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,094 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:34,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:34,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:34,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:34,096 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:34,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:34,096 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,097 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:34,097 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,197 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:34,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:34,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:34,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:34,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,207 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:34,207 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:34,207 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-13 21:55:34,207 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-13 21:55:34,208 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,208 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,209 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,209 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:34,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:34,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:34,210 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:34,210 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,211 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,212 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-13 21:55:34,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:34,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-13 21:55:34,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:34,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-13 21:55:34,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 21:55:34,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:34,212 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:34,212 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. started... 2023-02-13 21:55:34,212 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 04b9f9298378fddd0e87b95e75732d22 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-13 21:55:34,622 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200836075ffaf3454aa0e051b968ed8e6c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200836075ffaf3454aa0e051b968ed8e6c 2023-02-13 21:55:35,028 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/fcaa07f6829b4e75bdfcd4d383033899 2023-02-13 21:55:35,037 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/fcaa07f6829b4e75bdfcd4d383033899 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899 2023-02-13 21:55:35,040 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899, entries=1, sequenceid=41, filesize=4.9 K 2023-02-13 21:55:35,041 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 04b9f9298378fddd0e87b95e75732d22 in 829ms, sequenceid=41, compaction requested=true 2023-02-13 21:55:35,041 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:35,041 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:35,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 21:55:35,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 21:55:35,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-13 21:55:35,041 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-13 21:55:35,042 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,042 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:35,042 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,042 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:35,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-13 21:55:35,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a0e7f7[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:35,044 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-13 21:55:35,044 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,044 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-13 21:55:35,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-13 21:55:35,044 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:35,044 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,045 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:35,045 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-13 21:55:35,045 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,045 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:35,045 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-13 21:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:35,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:35,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-13 21:55:35,047 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-13 21:55:35,047 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:35,047 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:35,047 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,047 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:35,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,047 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,048 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:35,048 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,049 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:35,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-13 21:55:35,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,050 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:35,050 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:35,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:35,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:35,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:35,050 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,150 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:35,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:35,154 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-13 21:55:35,157 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:55:35,159 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:55:35,161 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325935161 2023-02-13 21:55:35,161 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:55:35,162 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-13 21:55:35,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-13 21:55:35,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:35,164 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x50a4447b to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:35,168 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a086db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:35,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:35,995 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010391cba134b43a485c8844bde0ae0e6b8b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010391cba134b43a485c8844bde0ae0e6b8b 2023-02-13 21:55:35,996 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:36,011 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:36,012 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:36,017 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:55:36,018 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:55:36,026 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86b5a1e992344cb79db8f4e3b07c3a47 first=Optional[r5] last=Optional[r6] 2023-02-13 21:55:36,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86b5a1e992344cb79db8f4e3b07c3a47}] 2023-02-13 21:55:36,030 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86b5a1e992344cb79db8f4e3b07c3a47 for inclusion in 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-13 21:55:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:55:36,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:36,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/86b5a1e992344cb79db8f4e3b07c3a47 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7kh6e5h8r6eegf4tniqjooihfmn49vgn4o4t0a150c6ue42ced5aidk6vsup9i9q/family1/86b5a1e992344cb79db8f4e3b07c3a47 2023-02-13 21:55:36,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7kh6e5h8r6eegf4tniqjooihfmn49vgn4o4t0a150c6ue42ced5aidk6vsup9i9q/family1/86b5a1e992344cb79db8f4e3b07c3a47 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_ 2023-02-13 21:55:36,038 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7kh6e5h8r6eegf4tniqjooihfmn49vgn4o4t0a150c6ue42ced5aidk6vsup9i9q/family1/86b5a1e992344cb79db8f4e3b07c3a47 into 04b9f9298378fddd0e87b95e75732d22/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_ - updating store file list. 2023-02-13 21:55:36,042 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_ into 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:36,042 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7kh6e5h8r6eegf4tniqjooihfmn49vgn4o4t0a150c6ue42ced5aidk6vsup9i9q/family1/86b5a1e992344cb79db8f4e3b07c3a47 into 04b9f9298378fddd0e87b95e75732d22/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_) 2023-02-13 21:55:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7kh6e5h8r6eegf4tniqjooihfmn49vgn4o4t0a150c6ue42ced5aidk6vsup9i9q/family1/86b5a1e992344cb79db8f4e3b07c3a47 2023-02-13 21:55:36,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-13 21:55:36,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-13 21:55:36,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(1912): 04b9f9298378fddd0e87b95e75732d22/family1 is initiating minor compaction 2023-02-13 21:55:36,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7fc3dd44; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:36,045 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 04b9f9298378fddd0e87b95e75732d22/family1 in testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:36,045 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp, totalSize=49.7 K 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 0fd27d0846214a3987bd34716562f210, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 09a010bdbf164c129d0b61946279bc2f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 1c6e3ba570cc43c9b24347caba03b962, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 46deedc123664609b49c55ffacef0a37, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 4913fb35b0d548a8b2ea583871f40963, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 1dfeb54e730649d8b6c784d17b671fb9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 5823102ec3f745b8bcb1aa56cb12c580, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d5a8317d45d6412f92a833fdd360319f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting fcaa07f6829b4e75bdfcd4d383033899, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-13 21:55:36,045 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 6abd559b4e034c93b56387974aca144d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-13 21:55:36,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:36,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:36,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011624073886274cb2bc7ffc24100428eb to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601011624073886274cb2bc7ffc24100428eb 2023-02-13 21:55:36,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae6e7664da6c427e8afc518691652306 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae6e7664da6c427e8afc518691652306 2023-02-13 21:55:36,048 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-13 21:55:36,048 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-13 21:55:36,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:36,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:36,070 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 04b9f9298378fddd0e87b95e75732d22#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:36,498 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/2967410e62bd4046b9be015afe989eb2 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/2967410e62bd4046b9be015afe989eb2 2023-02-13 21:55:36,502 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 04b9f9298378fddd0e87b95e75732d22/family1 of 04b9f9298378fddd0e87b95e75732d22 into 2967410e62bd4046b9be015afe989eb2(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:36,502 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:36,502 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676325336044; duration=0sec 2023-02-13 21:55:36,502 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:36,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_] to archive 2023-02-13 21:55:36,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:36,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0fd27d0846214a3987bd34716562f210 2023-02-13 21:55:36,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/09a010bdbf164c129d0b61946279bc2f 2023-02-13 21:55:36,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1c6e3ba570cc43c9b24347caba03b962 2023-02-13 21:55:36,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/46deedc123664609b49c55ffacef0a37 2023-02-13 21:55:36,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/4913fb35b0d548a8b2ea583871f40963 2023-02-13 21:55:36,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/1dfeb54e730649d8b6c784d17b671fb9 2023-02-13 21:55:36,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/5823102ec3f745b8bcb1aa56cb12c580 2023-02-13 21:55:36,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d5a8317d45d6412f92a833fdd360319f 2023-02-13 21:55:36,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/fcaa07f6829b4e75bdfcd4d383033899 2023-02-13 21:55:36,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/6abd559b4e034c93b56387974aca144d_SeqId_44_ 2023-02-13 21:55:36,904 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319b35cca515f84450b015fcf3c4382a0b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319b35cca515f84450b015fcf3c4382a0b 2023-02-13 21:55:36,905 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:36,929 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7c530e76ed35493bb09d78da02eaba22 first=Optional[r1] last=Optional[r4] 2023-02-13 21:55:36,929 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7c530e76ed35493bb09d78da02eaba22}] 2023-02-13 21:55:36,932 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7c530e76ed35493bb09d78da02eaba22 for inclusion in 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:36,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-13 21:55:36,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:55:36,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:36,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/7c530e76ed35493bb09d78da02eaba22 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d6onc1983lmd50uvb97im3kbd95os9iu76f2sj8ldp8ddruqf6i6omcu7mhtr5bf/family1/7c530e76ed35493bb09d78da02eaba22 2023-02-13 21:55:36,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d6onc1983lmd50uvb97im3kbd95os9iu76f2sj8ldp8ddruqf6i6omcu7mhtr5bf/family1/7c530e76ed35493bb09d78da02eaba22 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_ 2023-02-13 21:55:36,938 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d6onc1983lmd50uvb97im3kbd95os9iu76f2sj8ldp8ddruqf6i6omcu7mhtr5bf/family1/7c530e76ed35493bb09d78da02eaba22 into 04b9f9298378fddd0e87b95e75732d22/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_ - updating store file list. 2023-02-13 21:55:36,942 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_ into 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:36,942 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d6onc1983lmd50uvb97im3kbd95os9iu76f2sj8ldp8ddruqf6i6omcu7mhtr5bf/family1/7c530e76ed35493bb09d78da02eaba22 into 04b9f9298378fddd0e87b95e75732d22/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_) 2023-02-13 21:55:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__d6onc1983lmd50uvb97im3kbd95os9iu76f2sj8ldp8ddruqf6i6omcu7mhtr5bf/family1/7c530e76ed35493bb09d78da02eaba22 2023-02-13 21:55:36,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-13 21:55:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-13 21:55:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(1912): 04b9f9298378fddd0e87b95e75732d22/family1 is initiating minor compaction (all files) 2023-02-13 21:55:36,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@630e2633; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:36,943 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 04b9f9298378fddd0e87b95e75732d22/family1 in testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:36,944 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/2967410e62bd4046b9be015afe989eb2, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp, totalSize=178.1 K 2023-02-13 21:55:36,944 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting d381528fc8cc4f81b3b50392cbe2374b, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878809985 2023-02-13 21:55:36,944 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 2967410e62bd4046b9be015afe989eb2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621209985 2023-02-13 21:55:36,945 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] compactions.Compactor(207): Compacting 7d6dca8355b14150b333629507bd004a_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965209985 2023-02-13 21:55:36,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:36,945 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:36,947 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201711be2e675d84e6c816727c7c50378e4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201711be2e675d84e6c816727c7c50378e4 2023-02-13 21:55:36,947 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c476ff458dd646358faa8136fe6ddf65 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c476ff458dd646358faa8136fe6ddf65 2023-02-13 21:55:36,948 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4345dd889aa425094453a4d8a304201 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228d4345dd889aa425094453a4d8a304201 2023-02-13 21:55:36,949 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310e215225566c412d9a9686573ddb4990 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310e215225566c412d9a9686573ddb4990 2023-02-13 21:55:36,949 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-13 21:55:36,949 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-13 21:55:36,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:36,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:36,958 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] throttle.PressureAwareThroughputController(145): 04b9f9298378fddd0e87b95e75732d22#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-13 21:55:37,393 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303c0f42374ac6477aaa65bce0cb40f236 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511303c0f42374ac6477aaa65bce0cb40f236 2023-02-13 21:55:37,394 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:37,421 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2147852dfa734afba170c827b8975e73 first=Optional[r00] last=Optional[r8] 2023-02-13 21:55:37,422 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2147852dfa734afba170c827b8975e73}] 2023-02-13 21:55:37,424 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2147852dfa734afba170c827b8975e73 for inclusion in 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:37,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-13 21:55:37,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last= 2023-02-13 21:55:37,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:37,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2147852dfa734afba170c827b8975e73 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vi6bdgs90lr9ffrcumu97b6honi26788n3tbusfp8u3pouj7kj939punbiu2ggnd/family1/2147852dfa734afba170c827b8975e73 2023-02-13 21:55:37,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vi6bdgs90lr9ffrcumu97b6honi26788n3tbusfp8u3pouj7kj939punbiu2ggnd/family1/2147852dfa734afba170c827b8975e73 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0e8d79412dca4b68b84ef6b5340e8b79_SeqId_49_ 2023-02-13 21:55:37,429 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vi6bdgs90lr9ffrcumu97b6honi26788n3tbusfp8u3pouj7kj939punbiu2ggnd/family1/2147852dfa734afba170c827b8975e73 into 04b9f9298378fddd0e87b95e75732d22/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0e8d79412dca4b68b84ef6b5340e8b79_SeqId_49_ - updating store file list. 2023-02-13 21:55:37,432 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0e8d79412dca4b68b84ef6b5340e8b79_SeqId_49_ into 04b9f9298378fddd0e87b95e75732d22/family1 2023-02-13 21:55:37,432 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vi6bdgs90lr9ffrcumu97b6honi26788n3tbusfp8u3pouj7kj939punbiu2ggnd/family1/2147852dfa734afba170c827b8975e73 into 04b9f9298378fddd0e87b95e75732d22/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/0e8d79412dca4b68b84ef6b5340e8b79_SeqId_49_) 2023-02-13 21:55:37,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vi6bdgs90lr9ffrcumu97b6honi26788n3tbusfp8u3pouj7kj939punbiu2ggnd/family1/2147852dfa734afba170c827b8975e73 2023-02-13 21:55:37,434 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:37,434 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:37,436 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200836075ffaf3454aa0e051b968ed8e6c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200836075ffaf3454aa0e051b968ed8e6c 2023-02-13 21:55:37,437 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281df85fab757b4cc99d98e08578d73179 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511281df85fab757b4cc99d98e08578d73179 2023-02-13 21:55:37,438 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307a701380cc0d4c9db1ef74d57f428955 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307a701380cc0d4c9db1ef74d57f428955 2023-02-13 21:55:37,438 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-13 21:55:37,438 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-13 21:55:37,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:37,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:37,439 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-13 21:55:37,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-13 21:55:37,439 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:55:37,441 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-13 21:55:37,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2850 sec 2023-02-13 21:55:37,613 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=261 (was 248) - Thread LEAK? -, OpenFileDescriptor=647 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 239), ProcessCount=165 (was 165), AvailableMemoryMB=6918 (was 7149) 2023-02-13 21:55:37,624 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=261, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=165, AvailableMemoryMB=6917 2023-02-13 21:55:37,642 DEBUG [Listener at localhost.localdomain/39503] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-13 21:55:37,687 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-13 21:55:37,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-13 21:55:37,689 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 21:55:37,689 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-13 21:55:37,690 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 21:55:37,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:37,691 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df empty. 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7 empty. 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492 empty. 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:37,692 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:37,692 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-13 21:55:37,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:37,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:38,102 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-13 21:55:38,105 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9c44b5c0318571f7361b3af71ed6a4df, NAME => 'testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:38,106 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2869b6d4f3e95dcc2a7111118c48a492, NAME => 'testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:38,107 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0f0e2277e16292ae0c31d8b8151222b7, NAME => 'testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/.tmp 2023-02-13 21:55:38,188 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/.tmp/family1/23231373a67b4f1bb6e5d3b6db3fbb4a as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/23231373a67b4f1bb6e5d3b6db3fbb4a 2023-02-13 21:55:38,194 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 04b9f9298378fddd0e87b95e75732d22/family1 of 04b9f9298378fddd0e87b95e75732d22 into 23231373a67b4f1bb6e5d3b6db3fbb4a(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:38,194 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 04b9f9298378fddd0e87b95e75732d22: 2023-02-13 21:55:38,194 INFO [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676325336943; duration=1sec 2023-02-13 21:55:38,194 DEBUG [RS:0;jenkins-hbase20:34815-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-13 21:55:38,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/2967410e62bd4046b9be015afe989eb2, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_] to archive 2023-02-13 21:55:38,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:38,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:38,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/d381528fc8cc4f81b3b50392cbe2374b 2023-02-13 21:55:38,301 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/2967410e62bd4046b9be015afe989eb2 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/2967410e62bd4046b9be015afe989eb2 2023-02-13 21:55:38,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_ to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/family1/7d6dca8355b14150b333629507bd004a_SeqId_47_ 2023-02-13 21:55:38,517 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,517 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,517 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 9c44b5c0318571f7361b3af71ed6a4df, disabling compactions & flushes 2023-02-13 21:55:38,517 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 2869b6d4f3e95dcc2a7111118c48a492, disabling compactions & flushes 2023-02-13 21:55:38,517 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,518 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. after waiting 0 ms 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. after waiting 0 ms 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,518 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,519 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,519 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 9c44b5c0318571f7361b3af71ed6a4df: Waiting for close lock at 1676325338517Disabling compacts and flushes for region at 1676325338517Disabling writes for close at 1676325338518 (+1 ms)Writing region close event to WAL at 1676325338519 (+1 ms)Closed at 1676325338519 2023-02-13 21:55:38,519 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 2869b6d4f3e95dcc2a7111118c48a492: Waiting for close lock at 1676325338517Disabling compacts and flushes for region at 1676325338517Disabling writes for close at 1676325338518 (+1 ms)Writing region close event to WAL at 1676325338519 (+1 ms)Closed at 1676325338519 2023-02-13 21:55:38,538 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 0f0e2277e16292ae0c31d8b8151222b7, disabling compactions & flushes 2023-02-13 21:55:38,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. after waiting 0 ms 2023-02-13 21:55:38,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,539 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,539 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 0f0e2277e16292ae0c31d8b8151222b7: Waiting for close lock at 1676325338539Disabling compacts and flushes for region at 1676325338539Disabling writes for close at 1676325338539Writing region close event to WAL at 1676325338539Closed at 1676325338539 2023-02-13 21:55:38,544 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 21:55:38,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325338545"}]},"ts":"1676325338545"} 2023-02-13 21:55:38,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325338545"}]},"ts":"1676325338545"} 2023-02-13 21:55:38,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676325338545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676325338545"}]},"ts":"1676325338545"} 2023-02-13 21:55:38,549 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-13 21:55:38,550 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 21:55:38,550 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325338550"}]},"ts":"1676325338550"} 2023-02-13 21:55:38,551 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-13 21:55:38,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c44b5c0318571f7361b3af71ed6a4df, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0e2277e16292ae0c31d8b8151222b7, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2869b6d4f3e95dcc2a7111118c48a492, ASSIGN}] 2023-02-13 21:55:38,557 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c44b5c0318571f7361b3af71ed6a4df, ASSIGN 2023-02-13 21:55:38,557 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2869b6d4f3e95dcc2a7111118c48a492, ASSIGN 2023-02-13 21:55:38,557 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0e2277e16292ae0c31d8b8151222b7, ASSIGN 2023-02-13 21:55:38,558 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2869b6d4f3e95dcc2a7111118c48a492, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:38,558 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c44b5c0318571f7361b3af71ed6a4df, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:38,558 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0e2277e16292ae0c31d8b8151222b7, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,34815,1676325186101; forceNewPlan=false, retain=false 2023-02-13 21:55:38,710 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=2869b6d4f3e95dcc2a7111118c48a492, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,710 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0f0e2277e16292ae0c31d8b8151222b7, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,710 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338710"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325338710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325338710"}]},"ts":"1676325338710"} 2023-02-13 21:55:38,711 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676325338710"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325338710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325338710"}]},"ts":"1676325338710"} 2023-02-13 21:55:38,710 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=9c44b5c0318571f7361b3af71ed6a4df, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,711 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338710"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676325338710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676325338710"}]},"ts":"1676325338710"} 2023-02-13 21:55:38,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 2869b6d4f3e95dcc2a7111118c48a492, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:38,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 0f0e2277e16292ae0c31d8b8151222b7, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:38,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 9c44b5c0318571f7361b3af71ed6a4df, server=jenkins-hbase20.apache.org,34815,1676325186101}] 2023-02-13 21:55:38,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:38,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2869b6d4f3e95dcc2a7111118c48a492, NAME => 'testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.', STARTKEY => '2', ENDKEY => ''} 2023-02-13 21:55:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,894 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,896 DEBUG [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1 2023-02-13 21:55:38,896 DEBUG [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1 2023-02-13 21:55:38,896 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2869b6d4f3e95dcc2a7111118c48a492 columnFamilyName family1 2023-02-13 21:55:38,898 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] regionserver.HStore(310): Store=2869b6d4f3e95dcc2a7111118c48a492/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,898 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,899 DEBUG [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2 2023-02-13 21:55:38,899 DEBUG [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2 2023-02-13 21:55:38,899 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2869b6d4f3e95dcc2a7111118c48a492 columnFamilyName family2 2023-02-13 21:55:38,901 INFO [StoreOpener-2869b6d4f3e95dcc2a7111118c48a492-1] regionserver.HStore(310): Store=2869b6d4f3e95dcc2a7111118c48a492/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,903 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:38,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:38,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:38,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 2869b6d4f3e95dcc2a7111118c48a492; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68359747, jitterRate=0.018639609217643738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:38,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 2869b6d4f3e95dcc2a7111118c48a492: Running coprocessor pre-open hook at 1676325338868Writing region info on filesystem at 1676325338868Initializing all the Stores at 1676325338869 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338869Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338869Cleaning up temporary data from old regions at 1676325338902 (+33 ms)Cleaning up detritus from prior splits at 1676325338903 (+1 ms)Running coprocessor post-open hooks at 1676325338909 (+6 ms)Region opened successfully at 1676325338909 2023-02-13 21:55:38,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492., pid=120, masterSystemTime=1676325338865 2023-02-13 21:55:38,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:38,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9c44b5c0318571f7361b3af71ed6a4df, NAME => 'testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.', STARTKEY => '', ENDKEY => '1'} 2023-02-13 21:55:38,911 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=2869b6d4f3e95dcc2a7111118c48a492, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,911 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338911"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325338911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325338911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325338911"}]},"ts":"1676325338911"} 2023-02-13 21:55:38,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=119 2023-02-13 21:55:38,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 2869b6d4f3e95dcc2a7111118c48a492, server=jenkins-hbase20.apache.org,34815,1676325186101 in 200 msec 2023-02-13 21:55:38,914 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2869b6d4f3e95dcc2a7111118c48a492, ASSIGN in 359 msec 2023-02-13 21:55:38,934 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,935 DEBUG [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1 2023-02-13 21:55:38,935 DEBUG [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1 2023-02-13 21:55:38,935 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c44b5c0318571f7361b3af71ed6a4df columnFamilyName family1 2023-02-13 21:55:38,936 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] regionserver.HStore(310): Store=9c44b5c0318571f7361b3af71ed6a4df/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,936 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,937 DEBUG [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2 2023-02-13 21:55:38,937 DEBUG [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2 2023-02-13 21:55:38,938 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c44b5c0318571f7361b3af71ed6a4df columnFamilyName family2 2023-02-13 21:55:38,938 INFO [StoreOpener-9c44b5c0318571f7361b3af71ed6a4df-1] regionserver.HStore(310): Store=9c44b5c0318571f7361b3af71ed6a4df/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:38,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:38,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:38,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 9c44b5c0318571f7361b3af71ed6a4df; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67273565, jitterRate=0.002454236149787903}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:38,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 9c44b5c0318571f7361b3af71ed6a4df: Running coprocessor pre-open hook at 1676325338912Writing region info on filesystem at 1676325338912Initializing all the Stores at 1676325338912Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338912Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338913 (+1 ms)Cleaning up temporary data from old regions at 1676325338940 (+27 ms)Cleaning up detritus from prior splits at 1676325338940Running coprocessor post-open hooks at 1676325338944 (+4 ms)Region opened successfully at 1676325338944 2023-02-13 21:55:38,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df., pid=122, masterSystemTime=1676325338865 2023-02-13 21:55:38,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:38,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,948 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=9c44b5c0318571f7361b3af71ed6a4df, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0f0e2277e16292ae0c31d8b8151222b7, NAME => 'testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.', STARTKEY => '1', ENDKEY => '2'} 2023-02-13 21:55:38,948 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676325338948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325338948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325338948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325338948"}]},"ts":"1676325338948"} 2023-02-13 21:55:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 21:55:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-02-13 21:55:38,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 9c44b5c0318571f7361b3af71ed6a4df, server=jenkins-hbase20.apache.org,34815,1676325186101 in 236 msec 2023-02-13 21:55:38,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=9c44b5c0318571f7361b3af71ed6a4df, ASSIGN in 398 msec 2023-02-13 21:55:38,978 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,980 DEBUG [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1 2023-02-13 21:55:38,980 DEBUG [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1 2023-02-13 21:55:38,980 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f0e2277e16292ae0c31d8b8151222b7 columnFamilyName family1 2023-02-13 21:55:38,981 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] regionserver.HStore(310): Store=0f0e2277e16292ae0c31d8b8151222b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,981 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,983 DEBUG [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2 2023-02-13 21:55:38,983 DEBUG [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2 2023-02-13 21:55:38,983 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f0e2277e16292ae0c31d8b8151222b7 columnFamilyName family2 2023-02-13 21:55:38,984 INFO [StoreOpener-0f0e2277e16292ae0c31d8b8151222b7-1] regionserver.HStore(310): Store=0f0e2277e16292ae0c31d8b8151222b7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 21:55:38,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 21:55:38,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:38,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 21:55:38,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0f0e2277e16292ae0c31d8b8151222b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60026044, jitterRate=-0.10554224252700806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 21:55:38,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0f0e2277e16292ae0c31d8b8151222b7: Running coprocessor pre-open hook at 1676325338949Writing region info on filesystem at 1676325338949Initializing all the Stores at 1676325338950 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338950Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676325338955 (+5 ms)Cleaning up temporary data from old regions at 1676325338986 (+31 ms)Cleaning up detritus from prior splits at 1676325338986Running coprocessor post-open hooks at 1676325338990 (+4 ms)Region opened successfully at 1676325338990 2023-02-13 21:55:38,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7., pid=121, masterSystemTime=1676325338865 2023-02-13 21:55:38,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:38,992 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=0f0e2277e16292ae0c31d8b8151222b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:38,993 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676325338992"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676325338992"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676325338992"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676325338992"}]},"ts":"1676325338992"} 2023-02-13 21:55:38,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-13 21:55:38,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 0f0e2277e16292ae0c31d8b8151222b7, server=jenkins-hbase20.apache.org,34815,1676325186101 in 281 msec 2023-02-13 21:55:38,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-02-13 21:55:38,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0e2277e16292ae0c31d8b8151222b7, ASSIGN in 441 msec 2023-02-13 21:55:38,999 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 21:55:38,999 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676325338999"}]},"ts":"1676325338999"} 2023-02-13 21:55:39,000 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-13 21:55:39,002 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 21:55:39,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3160 sec 2023-02-13 21:55:39,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-13 21:55:39,799 INFO [Listener at localhost.localdomain/39503] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-13 21:55:39,808 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:39,809 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:39,809 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:39,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:39,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 21:55:39,814 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 21:55:39,814 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:39,814 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 21:55:39,814 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 21:55:39,815 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:39,815 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:39,815 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:39,815 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:39,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:39,816 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:39,816 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:39,816 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 21:55:39,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 21:55:39,817 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 21:55:39,817 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:39,817 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 21:55:39,817 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:39,817 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. started... 2023-02-13 21:55:39,817 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:39,817 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:39,818 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:39,818 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:39,817 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. started... 2023-02-13 21:55:39,818 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. started... 2023-02-13 21:55:39,818 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f0e2277e16292ae0c31d8b8151222b7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:39,818 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2869b6d4f3e95dcc2a7111118c48a492 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:39,818 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c44b5c0318571f7361b3af71ed6a4df 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-13 21:55:39,859 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213611c8ccf365d487baf6ca916807a6a79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213611c8ccf365d487baf6ca916807a6a79 2023-02-13 21:55:40,263 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302138a371bfdc28f483698767318280a36de to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302138a371bfdc28f483698767318280a36de 2023-02-13 21:55:40,263 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302138581303476b24725a61039532b1a603e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302138581303476b24725a61039532b1a603e 2023-02-13 21:55:40,274 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/1f85f382ca6a476ca9eed23ad6b00eef 2023-02-13 21:55:40,275 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/12af9b3357064f698c9927bf9d28ca21 2023-02-13 21:55:40,676 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/6d3291531cf24e78b6a352f5a4cd5e79 2023-02-13 21:55:40,700 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213b0233723850d42f0b6577f7dd542ee0d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213b0233723850d42f0b6577f7dd542ee0d 2023-02-13 21:55:40,701 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213a4e0b64034764275a9e4cc166640df48 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213a4e0b64034764275a9e4cc166640df48 2023-02-13 21:55:41,110 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/d28119bb5105469692756f8ddaea4348 2023-02-13 21:55:41,110 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/3cfe4d2a046447cf8eb6909828a4f4ce 2023-02-13 21:55:41,118 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213af3cd4e43dc84d099668ccb86bd3fa2f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213af3cd4e43dc84d099668ccb86bd3fa2f 2023-02-13 21:55:41,119 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/1f85f382ca6a476ca9eed23ad6b00eef as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef 2023-02-13 21:55:41,119 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/12af9b3357064f698c9927bf9d28ca21 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21 2023-02-13 21:55:41,140 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 21:55:41,140 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 21:55:41,141 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/3cfe4d2a046447cf8eb6909828a4f4ce as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce 2023-02-13 21:55:41,141 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/d28119bb5105469692756f8ddaea4348 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348 2023-02-13 21:55:41,144 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:41,144 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:41,145 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9c44b5c0318571f7361b3af71ed6a4df in 1327ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:41,145 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0f0e2277e16292ae0c31d8b8151222b7 in 1327ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:41,145 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 21:55:41,145 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-13 21:55:41,146 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:41,146 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:41,146 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:41,146 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:41,146 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:41,146 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:41,524 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/66bc539c17ab4899a8e02490a01ff517 2023-02-13 21:55:41,533 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/6d3291531cf24e78b6a352f5a4cd5e79 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79 2023-02-13 21:55:41,561 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79, entries=4, sequenceid=5, filesize=5.5 K 2023-02-13 21:55:41,562 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/66bc539c17ab4899a8e02490a01ff517 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517 2023-02-13 21:55:41,566 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517, entries=2, sequenceid=5, filesize=5.1 K 2023-02-13 21:55:41,566 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2869b6d4f3e95dcc2a7111118c48a492 in 1748ms, sequenceid=5, compaction requested=false 2023-02-13 21:55:41,566 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:41,567 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:41,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:41,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:41,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 21:55:41,567 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 21:55:41,568 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:41,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,568 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:41,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 21:55:41,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d8edce[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:41,569 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 21:55:41,569 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,570 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,570 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 21:55:41,570 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 21:55:41,570 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:41,570 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,570 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:41,571 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 21:55:41,571 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,571 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:41,571 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 21:55:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:41,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 21:55:41,573 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 21:55:41,573 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:41,573 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:41,573 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 21:55:41,573 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:41,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:41,574 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,574 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:41,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:41,575 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:41,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 21:55:41,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:41,577 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:41,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 21:55:41,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:41,577 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,677 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:41,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:41,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:41,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:41,680 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:41,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:41,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:41,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 21:55:41,686 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 21:55:41,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:41,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 21:55:41,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 21:55:41,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,686 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:41,687 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,687 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:41,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:41,688 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:41,688 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:41,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:41,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:41,689 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 21:55:41,689 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 21:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 21:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 21:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 21:55:41,689 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:41,690 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. started... 2023-02-13 21:55:41,690 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:41,690 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f0e2277e16292ae0c31d8b8151222b7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:41,690 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:41,690 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:41,690 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:41,690 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. started... 2023-02-13 21:55:41,690 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. started... 2023-02-13 21:55:41,690 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2869b6d4f3e95dcc2a7111118c48a492 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:41,690 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c44b5c0318571f7361b3af71ed6a4df 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-13 21:55:41,732 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ce5bd590b4b14ba8b8158330e4417c29 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213ce5bd590b4b14ba8b8158330e4417c29 2023-02-13 21:55:42,140 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ce2a60b642884b8eb84736f910956cf4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce2a60b642884b8eb84736f910956cf4 2023-02-13 21:55:42,141 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213fce8b19122a6404b9d28bc56510508a5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fce8b19122a6404b9d28bc56510508a5 2023-02-13 21:55:42,144 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/a8b9db32491b4bdf9b4728e24fa63ede 2023-02-13 21:55:42,556 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/01b9fce2bc5e4800937711bf271c4a83 2023-02-13 21:55:42,561 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/530488e7b36640dcb12729d7adfde613 2023-02-13 21:55:42,573 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213af6d359b550842fca697dc400f0e5d7e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213af6d359b550842fca697dc400f0e5d7e 2023-02-13 21:55:42,978 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/602b6adaad2949dbb6f2891e66feda55 2023-02-13 21:55:42,992 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/a8b9db32491b4bdf9b4728e24fa63ede as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede 2023-02-13 21:55:42,996 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213e7e5a4582b094678a99c1e1335fbd935 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213e7e5a4582b094678a99c1e1335fbd935 2023-02-13 21:55:42,997 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213eccf9bb5cf424c7ab69f0f7e8f991cf0 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213eccf9bb5cf424c7ab69f0f7e8f991cf0 2023-02-13 21:55:43,019 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 21:55:43,019 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/602b6adaad2949dbb6f2891e66feda55 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55 2023-02-13 21:55:43,023 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:43,023 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9c44b5c0318571f7361b3af71ed6a4df in 1333ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:43,023 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:43,023 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:43,023 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:43,403 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/0fc55c8d31534aeabd082652bc9e7b0b 2023-02-13 21:55:43,404 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/5ddf1db98ea2410194310620b0e6f94d 2023-02-13 21:55:43,414 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/530488e7b36640dcb12729d7adfde613 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613 2023-02-13 21:55:43,415 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/01b9fce2bc5e4800937711bf271c4a83 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83 2023-02-13 21:55:43,438 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 21:55:43,438 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613, entries=4, sequenceid=9, filesize=5.5 K 2023-02-13 21:55:43,438 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/5ddf1db98ea2410194310620b0e6f94d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d 2023-02-13 21:55:43,439 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/0fc55c8d31534aeabd082652bc9e7b0b as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b 2023-02-13 21:55:43,441 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:43,442 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-13 21:55:43,442 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2869b6d4f3e95dcc2a7111118c48a492 in 1752ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:43,442 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:43,442 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:43,442 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0f0e2277e16292ae0c31d8b8151222b7 in 1752ms, sequenceid=9, compaction requested=false 2023-02-13 21:55:43,442 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:43,442 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 21:55:43,442 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 21:55:43,443 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:43,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:43,444 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,444 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:43,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 21:55:43,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fe54f40[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:43,445 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 21:55:43,445 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,445 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,445 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 21:55:43,445 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 21:55:43,445 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:43,445 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,445 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:43,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 21:55:43,446 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:43,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 21:55:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:43,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 21:55:43,448 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 21:55:43,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:43,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:43,448 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 21:55:43,448 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:43,449 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,449 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:43,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,449 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:43,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:43,450 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,450 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:43,452 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 21:55:43,453 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:43,452 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:43,453 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:43,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:43,453 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:43,453 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:43,453 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:43,553 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:43,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:43,556 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:43,556 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:43,556 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:43,560 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 21:55:43,563 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 21:55:43,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:43,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 21:55:43,563 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 21:55:43,564 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,565 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:43,566 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:43,566 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:43,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:43,567 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:43,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:43,568 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 21:55:43,569 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 21:55:43,569 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 21:55:43,569 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 21:55:43,569 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:43,569 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 21:55:43,569 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:43,569 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:43,569 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:43,570 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:43,569 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:43,570 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. started... 2023-02-13 21:55:43,569 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. started... 2023-02-13 21:55:43,570 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2869b6d4f3e95dcc2a7111118c48a492 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:43,570 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. started... 2023-02-13 21:55:43,570 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f0e2277e16292ae0c31d8b8151222b7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:43,570 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c44b5c0318571f7361b3af71ed6a4df 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-13 21:55:44,013 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302133ae9ff0207a0472d8976108cb3555cf7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133ae9ff0207a0472d8976108cb3555cf7 2023-02-13 21:55:44,019 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213cfca4343ac17421f93afa0c2d6b00b3d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cfca4343ac17421f93afa0c2d6b00b3d 2023-02-13 21:55:44,019 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ab6bf2441c944c3e9bbcec602493b915 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ab6bf2441c944c3e9bbcec602493b915 2023-02-13 21:55:44,035 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/f7d8d3588cec45028afd56d9bd023adc 2023-02-13 21:55:44,414 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 21:55:44,430 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/4dc628e89997493c9e1959d6bc5adea6 2023-02-13 21:55:44,433 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/f4088150c61e41498fca5f54d3b7a96d 2023-02-13 21:55:44,464 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302132b6948b96c62458db80c1fce72d08880 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302132b6948b96c62458db80c1fce72d08880 2023-02-13 21:55:44,465 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213bb89c8a18da941afb49dcb98f7993c79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213bb89c8a18da941afb49dcb98f7993c79 2023-02-13 21:55:44,869 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/d34249075b684439b56aef4dba4add5c 2023-02-13 21:55:44,870 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/712978edac384634832885c9418f695f 2023-02-13 21:55:44,874 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213d8521c4f0002481c87c97a486ce1fd46 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213d8521c4f0002481c87c97a486ce1fd46 2023-02-13 21:55:44,875 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/f7d8d3588cec45028afd56d9bd023adc as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc 2023-02-13 21:55:44,876 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/f4088150c61e41498fca5f54d3b7a96d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d 2023-02-13 21:55:44,896 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 21:55:44,896 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 21:55:44,897 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/d34249075b684439b56aef4dba4add5c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c 2023-02-13 21:55:44,897 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/712978edac384634832885c9418f695f as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f 2023-02-13 21:55:44,900 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:44,900 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:44,900 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0f0e2277e16292ae0c31d8b8151222b7 in 1330ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:44,901 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:44,901 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:44,901 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2869b6d4f3e95dcc2a7111118c48a492 in 1331ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:44,901 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:44,901 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:44,901 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:44,901 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:45,280 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/e9938bdf9eea46f3bee0275b598b1d4d 2023-02-13 21:55:45,291 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/4dc628e89997493c9e1959d6bc5adea6 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6 2023-02-13 21:55:45,312 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6, entries=4, sequenceid=13, filesize=5.5 K 2023-02-13 21:55:45,313 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/e9938bdf9eea46f3bee0275b598b1d4d as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d 2023-02-13 21:55:45,316 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-13 21:55:45,317 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9c44b5c0318571f7361b3af71ed6a4df in 1747ms, sequenceid=13, compaction requested=true 2023-02-13 21:55:45,317 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:45,317 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:45,317 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:45,317 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:45,317 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,317 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 21:55:45,317 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 21:55:45,318 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,318 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:45,318 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,318 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:45,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:45,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 21:55:45,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37d6c752[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:45,320 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 21:55:45,320 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,320 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,320 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 21:55:45,320 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,321 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:45,320 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 21:55:45,321 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:45,321 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 21:55:45,321 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:45,321 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,321 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 21:55:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:45,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 21:55:45,323 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 21:55:45,323 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:45,323 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:45,323 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 21:55:45,323 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:45,324 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,324 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,324 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:45,325 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,326 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:45,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:45,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 21:55:45,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:45,328 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:45,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 21:55:45,328 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:45,329 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:45,329 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,329 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:45,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:45,329 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:45,329 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,429 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:45,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:45,433 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:45,433 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:45,433 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. with WAL disabled. Data may be lost in the event of a crash. 2023-02-13 21:55:45,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:45,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:45,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 21:55:45,442 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 21:55:45,442 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:45,442 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 21:55:45,442 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 21:55:45,443 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,443 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:45,444 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,444 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:45,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:45,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:45,444 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:45,444 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:45,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:45,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:45,446 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 21:55:45,446 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 21:55:45,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 21:55:45,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 21:55:45,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:45,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 21:55:45,446 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:45,446 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. started... 2023-02-13 21:55:45,446 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:45,446 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:45,447 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:45,447 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:45,447 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. started... 2023-02-13 21:55:45,447 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. started... 2023-02-13 21:55:45,447 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c44b5c0318571f7361b3af71ed6a4df 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:45,447 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f0e2277e16292ae0c31d8b8151222b7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:45,447 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2869b6d4f3e95dcc2a7111118c48a492 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-13 21:55:45,908 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:55:45,909 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c5d989f to 127.0.0.1:60489 2023-02-13 21:55:45,909 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:45,909 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:55:45,909 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50a4447b to 127.0.0.1:60489 2023-02-13 21:55:45,910 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:45,912 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213676b393126d344659c0d18bf1598e9b8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213676b393126d344659c0d18bf1598e9b8 2023-02-13 21:55:45,922 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213f9ca42054efd4c2d85732a162d302a49 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f9ca42054efd4c2d85732a162d302a49 2023-02-13 21:55:45,923 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021375dde6409dbd45b8b5a1e79182d07f74 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021375dde6409dbd45b8b5a1e79182d07f74 2023-02-13 21:55:45,923 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/da1cbeea1cdf48c49e6b356eb4461bbc 2023-02-13 21:55:45,935 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/eb992734a41647759691474c3959a205 2023-02-13 21:55:45,949 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230213ba6f0f28d0604fb095e207aebcf427c1 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230213ba6f0f28d0604fb095e207aebcf427c1 2023-02-13 21:55:46,336 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/ca55954b1bd24d19b19b8269dc4fe9f8 2023-02-13 21:55:46,354 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/7ac1f84f45a24f70920427bc6f28939e 2023-02-13 21:55:46,358 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/da1cbeea1cdf48c49e6b356eb4461bbc as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc 2023-02-13 21:55:46,371 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213ea4b3a2a05f54009967470ce733aaec9 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230213ea4b3a2a05f54009967470ce733aaec9 2023-02-13 21:55:46,385 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 21:55:46,385 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/7ac1f84f45a24f70920427bc6f28939e as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e 2023-02-13 21:55:46,389 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:46,389 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0f0e2277e16292ae0c31d8b8151222b7 in 942ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:46,389 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:46,389 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:46,390 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:46,777 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/8a62e0ce1e3e465c895b45f0d3a80a52 2023-02-13 21:55:46,781 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/eb992734a41647759691474c3959a205 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205 2023-02-13 21:55:46,800 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021306b117f9b6d0419394b3a47ac9abdd45 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023021306b117f9b6d0419394b3a47ac9abdd45 2023-02-13 21:55:46,812 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 21:55:46,812 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/8a62e0ce1e3e465c895b45f0d3a80a52 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52 2023-02-13 21:55:46,823 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:46,825 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9c44b5c0318571f7361b3af71ed6a4df in 1378ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:46,825 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:46,825 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:46,825 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:47,212 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/9eead4f5dfef41b2b74f46417e861490 2023-02-13 21:55:47,216 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/ca55954b1bd24d19b19b8269dc4fe9f8 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8 2023-02-13 21:55:47,238 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8, entries=4, sequenceid=17, filesize=5.5 K 2023-02-13 21:55:47,239 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/9eead4f5dfef41b2b74f46417e861490 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490 2023-02-13 21:55:47,243 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490, entries=2, sequenceid=17, filesize=5.1 K 2023-02-13 21:55:47,243 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2869b6d4f3e95dcc2a7111118c48a492 in 1796ms, sequenceid=17, compaction requested=true 2023-02-13 21:55:47,243 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:47,243 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:47,243 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:47,243 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:47,243 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,244 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 21:55:47,244 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 21:55:47,244 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,244 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:47,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,245 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:47,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 21:55:47,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@649a1100[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:47,246 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 21:55:47,246 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,246 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,246 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 21:55:47,246 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,246 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:47,246 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 21:55:47,246 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:47,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 21:55:47,247 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:47,247 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 21:55:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:47,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 21:55:47,249 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 21:55:47,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:47,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:47,249 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 21:55:47,249 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:47,250 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:47,250 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:47,250 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,251 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:47,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:47,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:47,252 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:47,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:47,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:47,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 21:55:47,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:47,252 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:47,253 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:47,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:47,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:47,353 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:47,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:47,365 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:47,373 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:47,380 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:47,380 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:47,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-13 21:55:47,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-13 21:55:47,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-13 21:55:47,462 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-13 21:55:47,462 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:47,462 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-13 21:55:47,462 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-13 21:55:47,462 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,462 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:47,463 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:47,463 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:47,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:47,463 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:47,463 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 21:55:47,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:47,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 21:55:47,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:47,464 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-13 21:55:47,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-13 21:55:47,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-13 21:55:47,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-13 21:55:47,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 21:55:47,469 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. started... 2023-02-13 21:55:47,470 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:47,470 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0f0e2277e16292ae0c31d8b8151222b7 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. started... 2023-02-13 21:55:47,470 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 21:55:47,470 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9c44b5c0318571f7361b3af71ed6a4df 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:47,470 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. started... 2023-02-13 21:55:47,470 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2869b6d4f3e95dcc2a7111118c48a492 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-13 21:55:48,309 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/1fcb742cd6e24846b2fef1aca47ae431 2023-02-13 21:55:48,312 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/8f7f0720df1c4cae935df7ba19a3bf09 2023-02-13 21:55:48,317 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/643d044ca7fe48049da040408a16fa9c 2023-02-13 21:55:48,337 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 643d044ca7fe48049da040408a16fa9c 2023-02-13 21:55:48,344 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f7f0720df1c4cae935df7ba19a3bf09 2023-02-13 21:55:48,344 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcb742cd6e24846b2fef1aca47ae431 2023-02-13 21:55:48,355 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/427d0768106646a4a0410b9e3c2dbf20 2023-02-13 21:55:48,357 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 427d0768106646a4a0410b9e3c2dbf20 2023-02-13 21:55:48,358 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/643d044ca7fe48049da040408a16fa9c as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c 2023-02-13 21:55:48,376 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 643d044ca7fe48049da040408a16fa9c 2023-02-13 21:55:48,376 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 21:55:48,377 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/427d0768106646a4a0410b9e3c2dbf20 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20 2023-02-13 21:55:48,380 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 427d0768106646a4a0410b9e3c2dbf20 2023-02-13 21:55:48,380 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:48,380 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2869b6d4f3e95dcc2a7111118c48a492 in 910ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:48,380 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:48,380 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:48,380 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-13 21:55:49,165 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/9439eb6fc9664212bbeea2fe4c7d9b94 2023-02-13 21:55:49,165 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/5327fd0410f14cd4942e6fcafe8ea8fd 2023-02-13 21:55:49,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9439eb6fc9664212bbeea2fe4c7d9b94 2023-02-13 21:55:49,176 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5327fd0410f14cd4942e6fcafe8ea8fd 2023-02-13 21:55:49,176 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/8f7f0720df1c4cae935df7ba19a3bf09 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09 2023-02-13 21:55:49,176 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/1fcb742cd6e24846b2fef1aca47ae431 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431 2023-02-13 21:55:49,204 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8f7f0720df1c4cae935df7ba19a3bf09 2023-02-13 21:55:49,204 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 21:55:49,205 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcb742cd6e24846b2fef1aca47ae431 2023-02-13 21:55:49,205 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431, entries=3, sequenceid=23, filesize=5.2 K 2023-02-13 21:55:49,205 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/9439eb6fc9664212bbeea2fe4c7d9b94 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94 2023-02-13 21:55:49,206 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/5327fd0410f14cd4942e6fcafe8ea8fd as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd 2023-02-13 21:55:49,208 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5327fd0410f14cd4942e6fcafe8ea8fd 2023-02-13 21:55:49,208 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9439eb6fc9664212bbeea2fe4c7d9b94 2023-02-13 21:55:49,209 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:49,209 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94, entries=1, sequenceid=23, filesize=5.0 K 2023-02-13 21:55:49,209 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0f0e2277e16292ae0c31d8b8151222b7 in 1739ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:49,209 INFO [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9c44b5c0318571f7361b3af71ed6a4df in 1739ms, sequenceid=23, compaction requested=true 2023-02-13 21:55:49,209 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:49,209 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:49,209 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:49,209 DEBUG [rs(jenkins-hbase20.apache.org,34815,1676325186101)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-13 21:55:49,209 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-13 21:55:49,210 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,210 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:49,211 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,211 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 21:55:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:49,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,34815,1676325186101' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-13 21:55:49,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-13 21:55:49,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@276f36c0[Count = 0] remaining members to acquire global barrier 2023-02-13 21:55:49,212 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,212 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,212 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-13 21:55:49,213 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-13 21:55:49,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,213 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 21:55:49,213 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,34815,1676325186101' in zk 2023-02-13 21:55:49,213 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-13 21:55:49,213 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,213 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,213 DEBUG [member: 'jenkins-hbase20.apache.org,34815,1676325186101' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-13 21:55:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,34815,1676325186101': 2023-02-13 21:55:49,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,34815,1676325186101' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-13 21:55:49,215 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-13 21:55:49,215 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 21:55:49,215 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 21:55:49,215 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-13 21:55:49,215 INFO [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 21:55:49,216 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,216 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:49,216 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 21:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 21:55:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,217 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 21:55:49,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 21:55:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,223 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 21:55:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-13 21:55:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 21:55:49,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,234 DEBUG [(jenkins-hbase20.apache.org,37155,1676325185079)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 21:55:49,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 21:55:49,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 21:55:49,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 21:55:49,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-13 21:55:49,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-13 21:55:49,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 21:55:49,234 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-13 21:55:49,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 21:55:49,235 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-13 21:55:49,335 DEBUG [Listener at localhost.localdomain/39503] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 21:55:49,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37155] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 21:55:49,336 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:49,336 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 0f0e2277e16292ae0c31d8b8151222b7/family1 is initiating major compaction (all files) 2023-02-13 21:55:49,336 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:49,336 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:49,337 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 0f0e2277e16292ae0c31d8b8151222b7/family1 in testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:49,337 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp, totalSize=27.1 K 2023-02-13 21:55:49,338 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 12af9b3357064f698c9927bf9d28ca21, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339809 2023-02-13 21:55:49,338 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 530488e7b36640dcb12729d7adfde613, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:49,339 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f4088150c61e41498fca5f54d3b7a96d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:49,339 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting da1cbeea1cdf48c49e6b356eb4461bbc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:49,339 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 8f7f0720df1c4cae935df7ba19a3bf09, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:49,347 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 0f0e2277e16292ae0c31d8b8151222b7#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:49,777 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del 2023-02-13 21:55:49,777 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del 2023-02-13 21:55:50,626 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0d7d8a578c4aaa94cb9bf19758aef4 2023-02-13 21:55:50,627 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family1/de0d7d8a578c4aaa94cb9bf19758aef4 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/de0d7d8a578c4aaa94cb9bf19758aef4 2023-02-13 21:55:50,644 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for de0d7d8a578c4aaa94cb9bf19758aef4 2023-02-13 21:55:50,645 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f0e2277e16292ae0c31d8b8151222b7/family1 of 0f0e2277e16292ae0c31d8b8151222b7 into de0d7d8a578c4aaa94cb9bf19758aef4(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:50,645 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:50,645 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:50,645 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 0f0e2277e16292ae0c31d8b8151222b7/family2 is initiating major compaction (all files) 2023-02-13 21:55:50,645 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:50,645 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:50,645 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 0f0e2277e16292ae0c31d8b8151222b7/family2 in testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:50,645 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp, totalSize=25.4 K 2023-02-13 21:55:50,646 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 3cfe4d2a046447cf8eb6909828a4f4ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339809 2023-02-13 21:55:50,646 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 0fc55c8d31534aeabd082652bc9e7b0b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:50,646 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 712978edac384634832885c9418f695f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:50,646 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 7ac1f84f45a24f70920427bc6f28939e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:50,647 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 9439eb6fc9664212bbeea2fe4c7d9b94, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:50,654 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 0f0e2277e16292ae0c31d8b8151222b7#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:50,660 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302136c7e43da31644737bc021531cefbfd6b_del 2023-02-13 21:55:50,660 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302136c7e43da31644737bc021531cefbfd6b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302136c7e43da31644737bc021531cefbfd6b_del 2023-02-13 21:55:50,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09] to archive 2023-02-13 21:55:50,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:50,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/12af9b3357064f698c9927bf9d28ca21 2023-02-13 21:55:50,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/530488e7b36640dcb12729d7adfde613 2023-02-13 21:55:50,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f4088150c61e41498fca5f54d3b7a96d 2023-02-13 21:55:50,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/da1cbeea1cdf48c49e6b356eb4461bbc 2023-02-13 21:55:50,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/8f7f0720df1c4cae935df7ba19a3bf09 2023-02-13 21:55:51,480 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3d8b4cfcb7a4e6699981a7015151373 2023-02-13 21:55:51,481 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/.tmp/family2/c3d8b4cfcb7a4e6699981a7015151373 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/c3d8b4cfcb7a4e6699981a7015151373 2023-02-13 21:55:51,484 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3d8b4cfcb7a4e6699981a7015151373 2023-02-13 21:55:51,485 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f0e2277e16292ae0c31d8b8151222b7/family2 of 0f0e2277e16292ae0c31d8b8151222b7 into c3d8b4cfcb7a4e6699981a7015151373(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:51,485 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:51,485 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:51,485 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 2869b6d4f3e95dcc2a7111118c48a492/family1 is initiating major compaction (all files) 2023-02-13 21:55:51,485 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:51,485 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:51,487 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 2869b6d4f3e95dcc2a7111118c48a492/family1 in testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:51,487 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp, totalSize=27.1 K 2023-02-13 21:55:51,487 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 6d3291531cf24e78b6a352f5a4cd5e79, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339809 2023-02-13 21:55:51,488 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 01b9fce2bc5e4800937711bf271c4a83, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:51,488 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting f7d8d3588cec45028afd56d9bd023adc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:51,488 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting ca55954b1bd24d19b19b8269dc4fe9f8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:51,489 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 643d044ca7fe48049da040408a16fa9c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:51,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94] to archive 2023-02-13 21:55:51,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:51,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/3cfe4d2a046447cf8eb6909828a4f4ce 2023-02-13 21:55:51,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/0fc55c8d31534aeabd082652bc9e7b0b 2023-02-13 21:55:51,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/712978edac384634832885c9418f695f 2023-02-13 21:55:51,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/7ac1f84f45a24f70920427bc6f28939e 2023-02-13 21:55:51,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family2/9439eb6fc9664212bbeea2fe4c7d9b94 2023-02-13 21:55:51,499 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 2869b6d4f3e95dcc2a7111118c48a492#family1#compaction#200 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:51,947 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del 2023-02-13 21:55:51,947 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del 2023-02-13 21:55:52,010 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a43699f210e4472f8d870fe8330aa6b8 2023-02-13 21:55:52,011 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family1/a43699f210e4472f8d870fe8330aa6b8 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/a43699f210e4472f8d870fe8330aa6b8 2023-02-13 21:55:52,033 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a43699f210e4472f8d870fe8330aa6b8 2023-02-13 21:55:52,034 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2869b6d4f3e95dcc2a7111118c48a492/family1 of 2869b6d4f3e95dcc2a7111118c48a492 into a43699f210e4472f8d870fe8330aa6b8(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:52,034 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:52,034 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:52,034 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 2869b6d4f3e95dcc2a7111118c48a492/family2 is initiating major compaction (all files) 2023-02-13 21:55:52,034 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:52,034 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:52,035 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 2869b6d4f3e95dcc2a7111118c48a492/family2 in testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:52,035 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp, totalSize=25.4 K 2023-02-13 21:55:52,036 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 66bc539c17ab4899a8e02490a01ff517, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339809 2023-02-13 21:55:52,036 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 5ddf1db98ea2410194310620b0e6f94d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:52,036 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting d34249075b684439b56aef4dba4add5c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:52,037 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 9eead4f5dfef41b2b74f46417e861490, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:52,037 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 427d0768106646a4a0410b9e3c2dbf20, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:52,044 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 2869b6d4f3e95dcc2a7111118c48a492#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:52,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c] to archive 2023-02-13 21:55:52,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:52,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/6d3291531cf24e78b6a352f5a4cd5e79 2023-02-13 21:55:52,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/01b9fce2bc5e4800937711bf271c4a83 2023-02-13 21:55:52,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/f7d8d3588cec45028afd56d9bd023adc 2023-02-13 21:55:52,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/ca55954b1bd24d19b19b8269dc4fe9f8 2023-02-13 21:55:52,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/643d044ca7fe48049da040408a16fa9c 2023-02-13 21:55:52,456 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230213a1276c9521fc4203883f57432e5fe003_del 2023-02-13 21:55:52,456 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213a1276c9521fc4203883f57432e5fe003_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230213a1276c9521fc4203883f57432e5fe003_del 2023-02-13 21:55:52,875 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afe5ff129742428488a95a106b182241 2023-02-13 21:55:52,877 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/.tmp/family2/afe5ff129742428488a95a106b182241 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/afe5ff129742428488a95a106b182241 2023-02-13 21:55:52,882 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for afe5ff129742428488a95a106b182241 2023-02-13 21:55:52,883 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2869b6d4f3e95dcc2a7111118c48a492/family2 of 2869b6d4f3e95dcc2a7111118c48a492 into afe5ff129742428488a95a106b182241(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:52,883 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:52,883 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:52,884 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 9c44b5c0318571f7361b3af71ed6a4df/family1 is initiating major compaction (all files) 2023-02-13 21:55:52,884 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:52,884 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:52,885 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 9c44b5c0318571f7361b3af71ed6a4df/family1 in testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:52,885 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp, totalSize=27.1 K 2023-02-13 21:55:52,886 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 1f85f382ca6a476ca9eed23ad6b00eef, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339808 2023-02-13 21:55:52,886 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting a8b9db32491b4bdf9b4728e24fa63ede, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:52,887 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 4dc628e89997493c9e1959d6bc5adea6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:52,887 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting eb992734a41647759691474c3959a205, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:52,888 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 1fcb742cd6e24846b2fef1aca47ae431, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:52,890 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20] to archive 2023-02-13 21:55:52,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:52,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/66bc539c17ab4899a8e02490a01ff517 2023-02-13 21:55:52,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/5ddf1db98ea2410194310620b0e6f94d 2023-02-13 21:55:52,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/d34249075b684439b56aef4dba4add5c 2023-02-13 21:55:52,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/9eead4f5dfef41b2b74f46417e861490 2023-02-13 21:55:52,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family2/427d0768106646a4a0410b9e3c2dbf20 2023-02-13 21:55:52,897 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 9c44b5c0318571f7361b3af71ed6a4df#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:53,336 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del 2023-02-13 21:55:53,336 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del 2023-02-13 21:55:54,188 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87b3fa5b97434c71a94ad78840b89aec 2023-02-13 21:55:54,189 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family1/87b3fa5b97434c71a94ad78840b89aec as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/87b3fa5b97434c71a94ad78840b89aec 2023-02-13 21:55:54,207 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87b3fa5b97434c71a94ad78840b89aec 2023-02-13 21:55:54,208 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c44b5c0318571f7361b3af71ed6a4df/family1 of 9c44b5c0318571f7361b3af71ed6a4df into 87b3fa5b97434c71a94ad78840b89aec(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-13 21:55:54,208 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:54,208 DEBUG [Listener at localhost.localdomain/39503] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-13 21:55:54,208 DEBUG [Listener at localhost.localdomain/39503] regionserver.HStore(1912): 9c44b5c0318571f7361b3af71ed6a4df/family2 is initiating major compaction (all files) 2023-02-13 21:55:54,209 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 21:55:54,209 INFO [Listener at localhost.localdomain/39503] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 21:55:54,209 INFO [Listener at localhost.localdomain/39503] regionserver.HRegion(2258): Starting compaction of 9c44b5c0318571f7361b3af71ed6a4df/family2 in testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:54,209 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd] into tmpdir=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp, totalSize=25.4 K 2023-02-13 21:55:54,209 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting d28119bb5105469692756f8ddaea4348, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676325339808 2023-02-13 21:55:54,210 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 602b6adaad2949dbb6f2891e66feda55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676325341680 2023-02-13 21:55:54,210 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting e9938bdf9eea46f3bee0275b598b1d4d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676325343556 2023-02-13 21:55:54,210 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 8a62e0ce1e3e465c895b45f0d3a80a52, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676325345433 2023-02-13 21:55:54,210 DEBUG [Listener at localhost.localdomain/39503] compactions.Compactor(207): Compacting 5327fd0410f14cd4942e6fcafe8ea8fd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-13 21:55:54,217 INFO [Listener at localhost.localdomain/39503] throttle.PressureAwareThroughputController(145): 9c44b5c0318571f7361b3af71ed6a4df#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-13 21:55:54,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431] to archive 2023-02-13 21:55:54,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:54,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1f85f382ca6a476ca9eed23ad6b00eef 2023-02-13 21:55:54,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/a8b9db32491b4bdf9b4728e24fa63ede 2023-02-13 21:55:54,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/4dc628e89997493c9e1959d6bc5adea6 2023-02-13 21:55:54,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/eb992734a41647759691474c3959a205 2023-02-13 21:55:54,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/1fcb742cd6e24846b2fef1aca47ae431 2023-02-13 21:55:54,629 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021395086bcb5a374802874fe521a5b89a52_del 2023-02-13 21:55:54,630 INFO [Listener at localhost.localdomain/39503] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021395086bcb5a374802874fe521a5b89a52_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021395086bcb5a374802874fe521a5b89a52_del 2023-02-13 21:55:55,045 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7873e8d147b49a9b8be5a3624722a25 2023-02-13 21:55:55,045 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/.tmp/family2/b7873e8d147b49a9b8be5a3624722a25 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/b7873e8d147b49a9b8be5a3624722a25 2023-02-13 21:55:55,050 INFO [Listener at localhost.localdomain/39503] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b7873e8d147b49a9b8be5a3624722a25 2023-02-13 21:55:55,051 INFO [Listener at localhost.localdomain/39503] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9c44b5c0318571f7361b3af71ed6a4df/family2 of 9c44b5c0318571f7361b3af71ed6a4df into b7873e8d147b49a9b8be5a3624722a25(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-13 21:55:55,051 DEBUG [Listener at localhost.localdomain/39503] regionserver.HRegion(2288): Compaction status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:55,056 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:55,060 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:55,065 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:55,066 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:55,071 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=37155] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x08.\x04F'\xD5\xE0\x98g\x9F\x1B\x083UXr"\x10\xF3\x88\x1B\x97\xFE\xD1G>\xD5i\xF3\x8E7\xB4\xD5\x81*\x10t\x89\xEB\x09\xEE\x83\xDC\xBB\x194\xEE\xF7\xD7\xF5\xB2`2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-13 21:55:55,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd] to archive 2023-02-13 21:55:55,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:55,092 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 21:55:55,093 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 21:55:55,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/d28119bb5105469692756f8ddaea4348 2023-02-13 21:55:55,093 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:55:55,093 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676325955093 2023-02-13 21:55:55,094 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-13 21:55:55,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/602b6adaad2949dbb6f2891e66feda55 2023-02-13 21:55:55,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/e9938bdf9eea46f3bee0275b598b1d4d 2023-02-13 21:55:55,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/8a62e0ce1e3e465c895b45f0d3a80a52 2023-02-13 21:55:55,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family2/5327fd0410f14cd4942e6fcafe8ea8fd 2023-02-13 21:55:55,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-13 21:55:55,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del 2023-02-13 21:55:55,393 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del 2023-02-13 21:55:55,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del 2023-02-13 21:55:55,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:55,411 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] zookeeper.ReadOnlyZKClient(139): Connect 0x60e360f4 to 127.0.0.1:60489 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 21:55:55,415 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f87d3bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 21:55:55,415 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:55,930 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 21:55:55,976 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302134f176f46e44b457686658d6ee5bf2e37 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302134f176f46e44b457686658d6ee5bf2e37 2023-02-13 21:55:55,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:55,986 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 21:55:55,988 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45758, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 21:55:55,996 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 21:55:55,997 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41258, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 21:55:56,026 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3c84143a7fa74af5b94b786a427c69b8 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-13 21:55:56,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3c84143a7fa74af5b94b786a427c69b8}] 2023-02-13 21:55:56,033 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3c84143a7fa74af5b94b786a427c69b8 for inclusion in 0f0e2277e16292ae0c31d8b8151222b7/family1 2023-02-13 21:55:56,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-13 21:55:56,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-13 21:55:56,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 0f0e2277e16292ae0c31d8b8151222b7: 2023-02-13 21:55:56,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213/family1/3c84143a7fa74af5b94b786a427c69b8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__20ivnrt5fr7s2als594huohjq5ln83is52mibsa1789tcnh63if3m5kcbe72ak4r/family1/3c84143a7fa74af5b94b786a427c69b8 2023-02-13 21:55:56,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__20ivnrt5fr7s2als594huohjq5ln83is52mibsa1789tcnh63if3m5kcbe72ak4r/family1/3c84143a7fa74af5b94b786a427c69b8 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f458b8015ac1432786a836336e534fa4_SeqId_28_ 2023-02-13 21:55:56,055 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__20ivnrt5fr7s2als594huohjq5ln83is52mibsa1789tcnh63if3m5kcbe72ak4r/family1/3c84143a7fa74af5b94b786a427c69b8 into 0f0e2277e16292ae0c31d8b8151222b7/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f458b8015ac1432786a836336e534fa4_SeqId_28_ - updating store file list. 2023-02-13 21:55:56,074 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f458b8015ac1432786a836336e534fa4_SeqId_28_ into 0f0e2277e16292ae0c31d8b8151222b7/family1 2023-02-13 21:55:56,074 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__20ivnrt5fr7s2als594huohjq5ln83is52mibsa1789tcnh63if3m5kcbe72ak4r/family1/3c84143a7fa74af5b94b786a427c69b8 into 0f0e2277e16292ae0c31d8b8151222b7/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/family1/f458b8015ac1432786a836336e534fa4_SeqId_28_) 2023-02-13 21:55:56,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__20ivnrt5fr7s2als594huohjq5ln83is52mibsa1789tcnh63if3m5kcbe72ak4r/family1/3c84143a7fa74af5b94b786a427c69b8 2023-02-13 21:55:56,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:56,077 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:56,078 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213676b393126d344659c0d18bf1598e9b8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213676b393126d344659c0d18bf1598e9b8 2023-02-13 21:55:56,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302138a371bfdc28f483698767318280a36de to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302138a371bfdc28f483698767318280a36de 2023-02-13 21:55:56,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cfca4343ac17421f93afa0c2d6b00b3d to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213cfca4343ac17421f93afa0c2d6b00b3d 2023-02-13 21:55:56,080 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fce8b19122a6404b9d28bc56510508a5 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230213fce8b19122a6404b9d28bc56510508a5 2023-02-13 21:55:56,080 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 21:55:56,080 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230213' 2023-02-13 21:55:56,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:56,080 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:57,007 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230213ef569a5b81d4491b9dd3bb63f1c7e65b to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ef569a5b81d4491b9dd3bb63f1c7e65b 2023-02-13 21:55:57,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:57,050 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/73d15982c66a4bcfb17e29f56af2ba78 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-13 21:55:57,050 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/73d15982c66a4bcfb17e29f56af2ba78}] 2023-02-13 21:55:57,052 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/73d15982c66a4bcfb17e29f56af2ba78 for inclusion in 2869b6d4f3e95dcc2a7111118c48a492/family1 2023-02-13 21:55:57,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-13 21:55:57,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-13 21:55:57,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 2869b6d4f3e95dcc2a7111118c48a492: 2023-02-13 21:55:57,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213/family1/73d15982c66a4bcfb17e29f56af2ba78 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__m050lqqiram6713rq3ecfrg78i1265nnftppt4f0npv4o60p2821l0pb8despg98/family1/73d15982c66a4bcfb17e29f56af2ba78 2023-02-13 21:55:57,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__m050lqqiram6713rq3ecfrg78i1265nnftppt4f0npv4o60p2821l0pb8despg98/family1/73d15982c66a4bcfb17e29f56af2ba78 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/fd73325376624aacbd58c93b884c6a21_SeqId_28_ 2023-02-13 21:55:57,072 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__m050lqqiram6713rq3ecfrg78i1265nnftppt4f0npv4o60p2821l0pb8despg98/family1/73d15982c66a4bcfb17e29f56af2ba78 into 2869b6d4f3e95dcc2a7111118c48a492/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/fd73325376624aacbd58c93b884c6a21_SeqId_28_ - updating store file list. 2023-02-13 21:55:57,089 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/fd73325376624aacbd58c93b884c6a21_SeqId_28_ into 2869b6d4f3e95dcc2a7111118c48a492/family1 2023-02-13 21:55:57,089 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__m050lqqiram6713rq3ecfrg78i1265nnftppt4f0npv4o60p2821l0pb8despg98/family1/73d15982c66a4bcfb17e29f56af2ba78 into 2869b6d4f3e95dcc2a7111118c48a492/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/family1/fd73325376624aacbd58c93b884c6a21_SeqId_28_) 2023-02-13 21:55:57,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__m050lqqiram6713rq3ecfrg78i1265nnftppt4f0npv4o60p2821l0pb8despg98/family1/73d15982c66a4bcfb17e29f56af2ba78 2023-02-13 21:55:57,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:57,091 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:57,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302138581303476b24725a61039532b1a603e to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302138581303476b24725a61039532b1a603e 2023-02-13 21:55:57,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ab6bf2441c944c3e9bbcec602493b915 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ab6bf2441c944c3e9bbcec602493b915 2023-02-13 21:55:57,094 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce2a60b642884b8eb84736f910956cf4 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213ce2a60b642884b8eb84736f910956cf4 2023-02-13 21:55:57,095 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f9ca42054efd4c2d85732a162d302a49 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230213f9ca42054efd4c2d85732a162d302a49 2023-02-13 21:55:57,095 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 21:55:57,095 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230213' 2023-02-13 21:55:57,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:57,095 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:57,180 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 21:55:58,028 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230213610b06f7a8554cdbb1a26951570bc088 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213610b06f7a8554cdbb1a26951570bc088 2023-02-13 21:55:58,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:58,066 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09a246235eec4ae29d58350ffd2de8a8 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-13 21:55:58,067 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df., hostname=jenkins-hbase20.apache.org,34815,1676325186101, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09a246235eec4ae29d58350ffd2de8a8}] 2023-02-13 21:55:58,069 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09a246235eec4ae29d58350ffd2de8a8 for inclusion in 9c44b5c0318571f7361b3af71ed6a4df/family1 2023-02-13 21:55:58,077 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-13 21:55:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-13 21:55:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(777): Region bounds: first= last=1 2023-02-13 21:55:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegion(2445): Flush status journal for 9c44b5c0318571f7361b3af71ed6a4df: 2023-02-13 21:55:58,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213/family1/09a246235eec4ae29d58350ffd2de8a8 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__fk8l3l8l5tkkl6a9gf6fp8p33poio7m21imgdctsv31l8769gahudna1du88cr68/family1/09a246235eec4ae29d58350ffd2de8a8 2023-02-13 21:55:58,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__fk8l3l8l5tkkl6a9gf6fp8p33poio7m21imgdctsv31l8769gahudna1du88cr68/family1/09a246235eec4ae29d58350ffd2de8a8 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/fa549f4793514c0b9c4d1c5727c4c0dc_SeqId_28_ 2023-02-13 21:55:58,094 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__fk8l3l8l5tkkl6a9gf6fp8p33poio7m21imgdctsv31l8769gahudna1du88cr68/family1/09a246235eec4ae29d58350ffd2de8a8 into 9c44b5c0318571f7361b3af71ed6a4df/family1 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/fa549f4793514c0b9c4d1c5727c4c0dc_SeqId_28_ - updating store file list. 2023-02-13 21:55:58,115 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/fa549f4793514c0b9c4d1c5727c4c0dc_SeqId_28_ into 9c44b5c0318571f7361b3af71ed6a4df/family1 2023-02-13 21:55:58,115 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__fk8l3l8l5tkkl6a9gf6fp8p33poio7m21imgdctsv31l8769gahudna1du88cr68/family1/09a246235eec4ae29d58350ffd2de8a8 into 9c44b5c0318571f7361b3af71ed6a4df/family1 (new location: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/family1/fa549f4793514c0b9c4d1c5727c4c0dc_SeqId_28_) 2023-02-13 21:55:58,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=34815] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/staging/jenkins__testMajorCompactionFromAdmin__fk8l3l8l5tkkl6a9gf6fp8p33poio7m21imgdctsv31l8769gahudna1du88cr68/family1/09a246235eec4ae29d58350ffd2de8a8 2023-02-13 21:55:58,117 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230213 table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:58,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:58,119 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133ae9ff0207a0472d8976108cb3555cf7 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302133ae9ff0207a0472d8976108cb3555cf7 2023-02-13 21:55:58,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213611c8ccf365d487baf6ca916807a6a79 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213611c8ccf365d487baf6ca916807a6a79 2023-02-13 21:55:58,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021375dde6409dbd45b8b5a1e79182d07f74 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023021375dde6409dbd45b8b5a1e79182d07f74 2023-02-13 21:55:58,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213ce5bd590b4b14ba8b8158330e4417c29 to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230213ce5bd590b4b14ba8b8158330e4417c29 2023-02-13 21:55:58,122 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-13 21:55:58,122 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230213' 2023-02-13 21:55:58,122 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230213 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:58,122 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-13 21:55:58,122 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-13 21:55:58,122 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del] 2023-02-13 21:55:58,122 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:58,123 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302134a4507dfadcc4b55aea4e4523ca0311b_del 2023-02-13 21:55:58,123 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 21:55:58,123 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del] 2023-02-13 21:55:58,124 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:58,125 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021366308c615c7b4d7d993e22ff75c78515_del 2023-02-13 21:55:58,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 21:55:58,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del] 2023-02-13 21:55:58,125 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(360): Archiving compacted files. 2023-02-13 21:55:58,126 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del to hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023021325a9f91ce4124d87992cbd2c551cb2ef_del 2023-02-13 21:55:58,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-13 21:55:58,126 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676325189870] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-13 21:55:58,127 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-13 21:55:58,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.0360 sec 2023-02-13 21:55:58,146 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:58,147 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:58,150 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-13 21:55:58,151 DEBUG [Listener at localhost.localdomain/39503] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-13 21:55:58,154 INFO [Listener at localhost.localdomain/39503] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 21:55:58,182 INFO [Listener at localhost.localdomain/39503] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=247 (was 261), OpenFileDescriptor=633 (was 647), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 202), ProcessCount=165 (was 165), AvailableMemoryMB=6658 (was 6917) 2023-02-13 21:55:58,182 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37d84738 to 127.0.0.1:60489 2023-02-13 21:55:58,183 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,183 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 21:55:58,183 INFO [Listener at localhost.localdomain/39503] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 21:55:58,183 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bf9b76d to 127.0.0.1:60489 2023-02-13 21:55:58,183 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,183 DEBUG [Listener at localhost.localdomain/39503] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 21:55:58,184 DEBUG [Listener at localhost.localdomain/39503] util.JVMClusterUtil(257): Found active master hash=58635207, stopped=false 2023-02-13 21:55:58,184 INFO [Listener at localhost.localdomain/39503] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:55:58,184 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 21:55:58,184 INFO [Listener at localhost.localdomain/39503] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 21:55:58,184 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:55:58,184 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 21:55:58,185 DEBUG [Listener at localhost.localdomain/39503] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fba7cf7 to 127.0.0.1:60489 2023-02-13 21:55:58,185 DEBUG [Listener at localhost.localdomain/39503] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 21:55:58,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 21:55:58,185 INFO [Listener at localhost.localdomain/39503] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,34815,1676325186101' ***** 2023-02-13 21:55:58,185 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1065): Closing user regions 2023-02-13 21:55:58,185 INFO [Listener at localhost.localdomain/39503] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 21:55:58,185 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for d553f6c4f5c52667324da766ddff8dd5 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 9c23d853d6e8509399ae6cfe49244a13 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 1d2600283ccd85bf4cfbfc3713f90a86 2023-02-13 21:55:58,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d553f6c4f5c52667324da766ddff8dd5, disabling compactions & flushes 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 109ab107cd1296e4625f25be450d7a0f 2023-02-13 21:55:58,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 5b7e5ba0bb2fea166e884933fad9757f 2023-02-13 21:55:58,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for bf66996b85c4bd7a85bdcb1ce93ad32b 2023-02-13 21:55:58,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. after waiting 0 ms 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 5f04de91d0e8a4ca6aaa34d6a7278404 2023-02-13 21:55:58,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 0f0e2277e16292ae0c31d8b8151222b7 2023-02-13 21:55:58,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing d553f6c4f5c52667324da766ddff8dd5 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 5d0fe5464154a71daceb6ef4c970ed03 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 2869b6d4f3e95dcc2a7111118c48a492 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for c5b526e37197c4eeeba0cee7de56cfa6 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 2c06786eceaa7d933a7952e04a95eb29 2023-02-13 21:55:58,186 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 689b141ebadbd35517e42061662afb17 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for fce6abe7b13ac32476557d444266c845 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for d5c1f8347d893cba27663b71b9d83b3b 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 04b9f9298378fddd0e87b95e75732d22 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 3fa3f38521a8386caacc176badb612e8 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for afec7cc7c29021c5831cdc083c828616 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 8f063bcc9162a76c6ed12c6cf5f8ce2f 2023-02-13 21:55:58,187 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 9c44b5c0318571f7361b3af71ed6a4df 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 21:55:58,188 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 9c23d853d6e8509399ae6cfe49244a13, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 1d2600283ccd85bf4cfbfc3713f90a86, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 109ab107cd1296e4625f25be450d7a0f, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,188 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 5b7e5ba0bb2fea166e884933fad9757f, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: bf66996b85c4bd7a85bdcb1ce93ad32b, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 5f04de91d0e8a4ca6aaa34d6a7278404, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 0f0e2277e16292ae0c31d8b8151222b7, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 5d0fe5464154a71daceb6ef4c970ed03, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 2869b6d4f3e95dcc2a7111118c48a492, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: c5b526e37197c4eeeba0cee7de56cfa6, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 2c06786eceaa7d933a7952e04a95eb29, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 689b141ebadbd35517e42061662afb17, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: fce6abe7b13ac32476557d444266c845, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: d5c1f8347d893cba27663b71b9d83b3b, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 04b9f9298378fddd0e87b95e75732d22, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 3fa3f38521a8386caacc176badb612e8, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: afec7cc7c29021c5831cdc083c828616, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 8f063bcc9162a76c6ed12c6cf5f8ce2f, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3306): Received CLOSE for the region: 9c44b5c0318571f7361b3af71ed6a4df, which we are already trying to CLOSE, but not completed yet 2023-02-13 21:55:58,189 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:58,189 DEBUG [RS:0;jenkins-hbase20:34815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x061299f7 to 127.0.0.1:60489 2023-02-13 21:55:58,189 DEBUG [RS:0;jenkins-hbase20:34815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,190 INFO [RS:0;jenkins-hbase20:34815] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 21:55:58,190 INFO [RS:0;jenkins-hbase20:34815] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 21:55:58,190 INFO [RS:0;jenkins-hbase20:34815] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 21:55:58,190 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 21:55:58,190 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-13 21:55:58,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 21:55:58,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 21:55:58,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 21:55:58,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 21:55:58,191 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 21:55:58,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-13 21:55:58,191 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1505): Waiting on 04b9f9298378fddd0e87b95e75732d22, 0f0e2277e16292ae0c31d8b8151222b7, 109ab107cd1296e4625f25be450d7a0f, 1588230740, 1d2600283ccd85bf4cfbfc3713f90a86, 2869b6d4f3e95dcc2a7111118c48a492, 2c06786eceaa7d933a7952e04a95eb29, 3fa3f38521a8386caacc176badb612e8, 5b7e5ba0bb2fea166e884933fad9757f, 5d0fe5464154a71daceb6ef4c970ed03, 5f04de91d0e8a4ca6aaa34d6a7278404, 689b141ebadbd35517e42061662afb17, 8f063bcc9162a76c6ed12c6cf5f8ce2f, 9c23d853d6e8509399ae6cfe49244a13, 9c44b5c0318571f7361b3af71ed6a4df, afec7cc7c29021c5831cdc083c828616, bf66996b85c4bd7a85bdcb1ce93ad32b, c5b526e37197c4eeeba0cee7de56cfa6, d553f6c4f5c52667324da766ddff8dd5, d5c1f8347d893cba27663b71b9d83b3b, fce6abe7b13ac32476557d444266c845 2023-02-13 21:55:58,197 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-13 21:55:58,256 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 21:55:58,392 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1505): Waiting on 04b9f9298378fddd0e87b95e75732d22, 0f0e2277e16292ae0c31d8b8151222b7, 109ab107cd1296e4625f25be450d7a0f, 1588230740, 1d2600283ccd85bf4cfbfc3713f90a86, 2869b6d4f3e95dcc2a7111118c48a492, 2c06786eceaa7d933a7952e04a95eb29, 3fa3f38521a8386caacc176badb612e8, 5b7e5ba0bb2fea166e884933fad9757f, 5d0fe5464154a71daceb6ef4c970ed03, 5f04de91d0e8a4ca6aaa34d6a7278404, 689b141ebadbd35517e42061662afb17, 8f063bcc9162a76c6ed12c6cf5f8ce2f, 9c23d853d6e8509399ae6cfe49244a13, 9c44b5c0318571f7361b3af71ed6a4df, afec7cc7c29021c5831cdc083c828616, bf66996b85c4bd7a85bdcb1ce93ad32b, c5b526e37197c4eeeba0cee7de56cfa6, d553f6c4f5c52667324da766ddff8dd5, d5c1f8347d893cba27663b71b9d83b3b, fce6abe7b13ac32476557d444266c845 2023-02-13 21:55:58,592 DEBUG [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1505): Waiting on 04b9f9298378fddd0e87b95e75732d22, 0f0e2277e16292ae0c31d8b8151222b7, 109ab107cd1296e4625f25be450d7a0f, 1588230740, 1d2600283ccd85bf4cfbfc3713f90a86, 2869b6d4f3e95dcc2a7111118c48a492, 2c06786eceaa7d933a7952e04a95eb29, 3fa3f38521a8386caacc176badb612e8, 5b7e5ba0bb2fea166e884933fad9757f, 5d0fe5464154a71daceb6ef4c970ed03, 5f04de91d0e8a4ca6aaa34d6a7278404, 689b141ebadbd35517e42061662afb17, 8f063bcc9162a76c6ed12c6cf5f8ce2f, 9c23d853d6e8509399ae6cfe49244a13, 9c44b5c0318571f7361b3af71ed6a4df, afec7cc7c29021c5831cdc083c828616, bf66996b85c4bd7a85bdcb1ce93ad32b, c5b526e37197c4eeeba0cee7de56cfa6, d553f6c4f5c52667324da766ddff8dd5, d5c1f8347d893cba27663b71b9d83b3b, fce6abe7b13ac32476557d444266c845 2023-02-13 21:55:58,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/.tmp/info/648bfe3cfd71463087e46507a9cb5c32 2023-02-13 21:55:58,599 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/info/597b6a9042e140b7a46adeb984de5f11 2023-02-13 21:55:58,601 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/.tmp/info/648bfe3cfd71463087e46507a9cb5c32 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/info/648bfe3cfd71463087e46507a9cb5c32 2023-02-13 21:55:58,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 597b6a9042e140b7a46adeb984de5f11 2023-02-13 21:55:58,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/info/648bfe3cfd71463087e46507a9cb5c32, entries=3, sequenceid=7, filesize=4.8 K 2023-02-13 21:55:58,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d553f6c4f5c52667324da766ddff8dd5 in 421ms, sequenceid=7, compaction requested=false 2023-02-13 21:55:58,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/namespace/d553f6c4f5c52667324da766ddff8dd5/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-13 21:55:58,612 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/rep_barrier/e9eaf40d5db043c0a54e17d497d536ea 2023-02-13 21:55:58,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d553f6c4f5c52667324da766ddff8dd5: Waiting for close lock at 1676325358186Running coprocessor pre-close hooks at 1676325358186Disabling compacts and flushes for region at 1676325358186Disabling writes for close at 1676325358186Obtaining lock to block concurrent updates at 1676325358186Preparing flush snapshotting stores in d553f6c4f5c52667324da766ddff8dd5 at 1676325358186Finished memstore snapshotting hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676325358186Flushing stores of hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. at 1676325358187 (+1 ms)Flushing d553f6c4f5c52667324da766ddff8dd5/info: creating writer at 1676325358187Flushing d553f6c4f5c52667324da766ddff8dd5/info: appending metadata at 1676325358189 (+2 ms)Flushing d553f6c4f5c52667324da766ddff8dd5/info: closing flushed file at 1676325358189Flushing d553f6c4f5c52667324da766ddff8dd5/info: reopening flushed file at 1676325358602 (+413 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d553f6c4f5c52667324da766ddff8dd5 in 421ms, sequenceid=7, compaction requested=false at 1676325358607 (+5 ms)Writing region close event to WAL at 1676325358609 (+2 ms)Running coprocessor post-close hooks at 1676325358612 (+3 ms)Closed at 1676325358613 (+1 ms) 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676325188730.d553f6c4f5c52667324da766ddff8dd5. 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9c23d853d6e8509399ae6cfe49244a13, disabling compactions & flushes 2023-02-13 21:55:58,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. after waiting 0 ms 2023-02-13 21:55:58,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:58,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9eaf40d5db043c0a54e17d497d536ea 2023-02-13 21:55:58,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/9c23d853d6e8509399ae6cfe49244a13/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 21:55:58,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:58,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9c23d853d6e8509399ae6cfe49244a13: Waiting for close lock at 1676325358613Running coprocessor pre-close hooks at 1676325358613Disabling compacts and flushes for region at 1676325358613Disabling writes for close at 1676325358613Writing region close event to WAL at 1676325358614 (+1 ms)Running coprocessor post-close hooks at 1676325358617 (+3 ms)Closed at 1676325358618 (+1 ms) 2023-02-13 21:55:58,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676325281733.9c23d853d6e8509399ae6cfe49244a13. 2023-02-13 21:55:58,618 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1d2600283ccd85bf4cfbfc3713f90a86, disabling compactions & flushes 2023-02-13 21:55:58,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:58,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:58,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. after waiting 0 ms 2023-02-13 21:55:58,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:58,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/1d2600283ccd85bf4cfbfc3713f90a86/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1d2600283ccd85bf4cfbfc3713f90a86: Waiting for close lock at 1676325358618Running coprocessor pre-close hooks at 1676325358618Disabling compacts and flushes for region at 1676325358618Disabling writes for close at 1676325358619 (+1 ms)Writing region close event to WAL at 1676325358619Running coprocessor post-close hooks at 1676325358622 (+3 ms)Closed at 1676325358623 (+1 ms) 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676325308721.1d2600283ccd85bf4cfbfc3713f90a86. 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 109ab107cd1296e4625f25be450d7a0f, disabling compactions & flushes 2023-02-13 21:55:58,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. after waiting 0 ms 2023-02-13 21:55:58,623 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:58,625 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/table/1d7a22cf8455446392bd826deb8628d5 2023-02-13 21:55:58,627 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/109ab107cd1296e4625f25be450d7a0f/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 21:55:58,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 109ab107cd1296e4625f25be450d7a0f: Waiting for close lock at 1676325358623Running coprocessor pre-close hooks at 1676325358623Disabling compacts and flushes for region at 1676325358623Disabling writes for close at 1676325358623Writing region close event to WAL at 1676325358624 (+1 ms)Running coprocessor post-close hooks at 1676325358627 (+3 ms)Closed at 1676325358628 (+1 ms) 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676325281733.109ab107cd1296e4625f25be450d7a0f. 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5b7e5ba0bb2fea166e884933fad9757f, disabling compactions & flushes 2023-02-13 21:55:58,628 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. after waiting 0 ms 2023-02-13 21:55:58,628 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:55:58,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d7a22cf8455446392bd826deb8628d5 2023-02-13 21:55:58,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/info/597b6a9042e140b7a46adeb984de5f11 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/info/597b6a9042e140b7a46adeb984de5f11 2023-02-13 21:55:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyPolicy/5b7e5ba0bb2fea166e884933fad9757f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 21:55:58,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5b7e5ba0bb2fea166e884933fad9757f: Waiting for close lock at 1676325358628Running coprocessor pre-close hooks at 1676325358628Disabling compacts and flushes for region at 1676325358628Disabling writes for close at 1676325358628Writing region close event to WAL at 1676325358629 (+1 ms)Running coprocessor post-close hooks at 1676325358631 (+2 ms)Closed at 1676325358632 (+1 ms) 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676325236483.5b7e5ba0bb2fea166e884933fad9757f. 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bf66996b85c4bd7a85bdcb1ce93ad32b, disabling compactions & flushes 2023-02-13 21:55:58,632 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. after waiting 0 ms 2023-02-13 21:55:58,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:58,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 597b6a9042e140b7a46adeb984de5f11 2023-02-13 21:55:58,633 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/info/597b6a9042e140b7a46adeb984de5f11, entries=226, sequenceid=130, filesize=37.9 K 2023-02-13 21:55:58,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/rep_barrier/e9eaf40d5db043c0a54e17d497d536ea as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/rep_barrier/e9eaf40d5db043c0a54e17d497d536ea 2023-02-13 21:55:58,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testCompactionWithHFileLink/bf66996b85c4bd7a85bdcb1ce93ad32b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-13 21:55:58,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:58,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bf66996b85c4bd7a85bdcb1ce93ad32b: Waiting for close lock at 1676325358632Running coprocessor pre-close hooks at 1676325358632Disabling compacts and flushes for region at 1676325358632Disabling writes for close at 1676325358632Writing region close event to WAL at 1676325358633 (+1 ms)Running coprocessor post-close hooks at 1676325358635 (+2 ms)Closed at 1676325358635 2023-02-13 21:55:58,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676325281733.bf66996b85c4bd7a85bdcb1ce93ad32b. 2023-02-13 21:55:58,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5f04de91d0e8a4ca6aaa34d6a7278404, disabling compactions & flushes 2023-02-13 21:55:58,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:55:58,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:55:58,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. after waiting 0 ms 2023-02-13 21:55:58,636 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:55:58,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9eaf40d5db043c0a54e17d497d536ea 2023-02-13 21:55:58,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/rep_barrier/e9eaf40d5db043c0a54e17d497d536ea, entries=1, sequenceid=130, filesize=5.0 K 2023-02-13 21:55:58,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/.tmp/table/1d7a22cf8455446392bd826deb8628d5 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/table/1d7a22cf8455446392bd826deb8628d5 2023-02-13 21:55:58,642 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5f04de91d0e8a4ca6aaa34d6a7278404/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 21:55:58,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5f04de91d0e8a4ca6aaa34d6a7278404: Waiting for close lock at 1676325358636Running coprocessor pre-close hooks at 1676325358636Disabling compacts and flushes for region at 1676325358636Disabling writes for close at 1676325358636Writing region close event to WAL at 1676325358636Running coprocessor post-close hooks at 1676325358642 (+6 ms)Closed at 1676325358643 (+1 ms) 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676325249616.5f04de91d0e8a4ca6aaa34d6a7278404. 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0f0e2277e16292ae0c31d8b8151222b7, disabling compactions & flushes 2023-02-13 21:55:58,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. after waiting 0 ms 2023-02-13 21:55:58,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:58,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d7a22cf8455446392bd826deb8628d5 2023-02-13 21:55:58,646 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/table/1d7a22cf8455446392bd826deb8628d5, entries=27, sequenceid=130, filesize=6.6 K 2023-02-13 21:55:58,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/0f0e2277e16292ae0c31d8b8151222b7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:58,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0f0e2277e16292ae0c31d8b8151222b7: Waiting for close lock at 1676325358643Running coprocessor pre-close hooks at 1676325358643Disabling compacts and flushes for region at 1676325358643Disabling writes for close at 1676325358643Writing region close event to WAL at 1676325358644 (+1 ms)Running coprocessor post-close hooks at 1676325358646 (+2 ms)Closed at 1676325358646 2023-02-13 21:55:58,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 456ms, sequenceid=130, compaction requested=false 2023-02-13 21:55:58,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676325337663.0f0e2277e16292ae0c31d8b8151222b7. 2023-02-13 21:55:58,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5d0fe5464154a71daceb6ef4c970ed03, disabling compactions & flushes 2023-02-13 21:55:58,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:55:58,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:55:58,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. after waiting 0 ms 2023-02-13 21:55:58,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:55:58,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/5d0fe5464154a71daceb6ef4c970ed03/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 21:55:58,650 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-13 21:55:58,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:55:58,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 21:55:58,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5d0fe5464154a71daceb6ef4c970ed03: Waiting for close lock at 1676325358648Running coprocessor pre-close hooks at 1676325358648Disabling compacts and flushes for region at 1676325358648Disabling writes for close at 1676325358648Writing region close event to WAL at 1676325358648Running coprocessor post-close hooks at 1676325358651 (+3 ms)Closed at 1676325358651 2023-02-13 21:55:58,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676325358191Running coprocessor pre-close hooks at 1676325358191Disabling compacts and flushes for region at 1676325358191Disabling writes for close at 1676325358191Obtaining lock to block concurrent updates at 1676325358191Preparing flush snapshotting stores in 1588230740 at 1676325358191Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676325358191Flushing stores of hbase:meta,,1.1588230740 at 1676325358192 (+1 ms)Flushing 1588230740/info: creating writer at 1676325358192Flushing 1588230740/info: appending metadata at 1676325358195 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676325358195Flushing 1588230740/rep_barrier: creating writer at 1676325358604 (+409 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676325358606 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676325358607 (+1 ms)Flushing 1588230740/table: creating writer at 1676325358616 (+9 ms)Flushing 1588230740/table: appending metadata at 1676325358619 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676325358619Flushing 1588230740/info: reopening flushed file at 1676325358629 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676325358634 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676325358641 (+7 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 456ms, sequenceid=130, compaction requested=false at 1676325358648 (+7 ms)Writing region close event to WAL at 1676325358649 (+1 ms)Running coprocessor post-close hooks at 1676325358651 (+2 ms)Closed at 1676325358652 (+1 ms) 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676325231466.5d0fe5464154a71daceb6ef4c970ed03. 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 2869b6d4f3e95dcc2a7111118c48a492, disabling compactions & flushes 2023-02-13 21:55:58,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. after waiting 0 ms 2023-02-13 21:55:58,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:58,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/2869b6d4f3e95dcc2a7111118c48a492/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:58,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 2869b6d4f3e95dcc2a7111118c48a492: Waiting for close lock at 1676325358652Running coprocessor pre-close hooks at 1676325358652Disabling compacts and flushes for region at 1676325358652Disabling writes for close at 1676325358652Writing region close event to WAL at 1676325358653 (+1 ms)Running coprocessor post-close hooks at 1676325358656 (+3 ms)Closed at 1676325358656 2023-02-13 21:55:58,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676325337663.2869b6d4f3e95dcc2a7111118c48a492. 2023-02-13 21:55:58,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing c5b526e37197c4eeeba0cee7de56cfa6, disabling compactions & flushes 2023-02-13 21:55:58,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:55:58,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:55:58,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. after waiting 0 ms 2023-02-13 21:55:58,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:55:58,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c5b526e37197c4eeeba0cee7de56cfa6/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-13 21:55:58,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for c5b526e37197c4eeeba0cee7de56cfa6: Waiting for close lock at 1676325358657Running coprocessor pre-close hooks at 1676325358657Disabling compacts and flushes for region at 1676325358657Disabling writes for close at 1676325358657Writing region close event to WAL at 1676325358657Running coprocessor post-close hooks at 1676325358660 (+3 ms)Closed at 1676325358660 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676325190023.c5b526e37197c4eeeba0cee7de56cfa6. 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 2c06786eceaa7d933a7952e04a95eb29, disabling compactions & flushes 2023-02-13 21:55:58,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. after waiting 0 ms 2023-02-13 21:55:58,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:55:58,663 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/2c06786eceaa7d933a7952e04a95eb29/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-13 21:55:58,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 2c06786eceaa7d933a7952e04a95eb29: Waiting for close lock at 1676325358660Running coprocessor pre-close hooks at 1676325358660Disabling compacts and flushes for region at 1676325358660Disabling writes for close at 1676325358660Writing region close event to WAL at 1676325358661 (+1 ms)Running coprocessor post-close hooks at 1676325358663 (+2 ms)Closed at 1676325358664 (+1 ms) 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676325231466.2c06786eceaa7d933a7952e04a95eb29. 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 689b141ebadbd35517e42061662afb17, disabling compactions & flushes 2023-02-13 21:55:58,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. after waiting 0 ms 2023-02-13 21:55:58,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:55:58,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithMonthlyPolicy/689b141ebadbd35517e42061662afb17/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 21:55:58,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 689b141ebadbd35517e42061662afb17: Waiting for close lock at 1676325358665Running coprocessor pre-close hooks at 1676325358665Disabling compacts and flushes for region at 1676325358665Disabling writes for close at 1676325358665Writing region close event to WAL at 1676325358665Running coprocessor post-close hooks at 1676325358668 (+3 ms)Closed at 1676325358668 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676325205594.689b141ebadbd35517e42061662afb17. 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing fce6abe7b13ac32476557d444266c845, disabling compactions & flushes 2023-02-13 21:55:58,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. after waiting 0 ms 2023-02-13 21:55:58,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:55:58,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testScannerOnBulkLoadRefHFiles/fce6abe7b13ac32476557d444266c845/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 21:55:58,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for fce6abe7b13ac32476557d444266c845: Waiting for close lock at 1676325358668Running coprocessor pre-close hooks at 1676325358668Disabling compacts and flushes for region at 1676325358668Disabling writes for close at 1676325358668Writing region close event to WAL at 1676325358668Running coprocessor post-close hooks at 1676325358671 (+3 ms)Closed at 1676325358671 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676325231466.fce6abe7b13ac32476557d444266c845. 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d5c1f8347d893cba27663b71b9d83b3b, disabling compactions & flushes 2023-02-13 21:55:58,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. after waiting 0 ms 2023-02-13 21:55:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/d5c1f8347d893cba27663b71b9d83b3b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d5c1f8347d893cba27663b71b9d83b3b: Waiting for close lock at 1676325358671Running coprocessor pre-close hooks at 1676325358671Disabling compacts and flushes for region at 1676325358671Disabling writes for close at 1676325358671Writing region close event to WAL at 1676325358672 (+1 ms)Running coprocessor post-close hooks at 1676325358674 (+2 ms)Closed at 1676325358674 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676325308721.d5c1f8347d893cba27663b71b9d83b3b. 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 04b9f9298378fddd0e87b95e75732d22, disabling compactions & flushes 2023-02-13 21:55:58,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. after waiting 0 ms 2023-02-13 21:55:58,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:58,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithMonthlyPolicy/04b9f9298378fddd0e87b95e75732d22/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-13 21:55:58,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:58,678 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 04b9f9298378fddd0e87b95e75732d22: Waiting for close lock at 1676325358674Running coprocessor pre-close hooks at 1676325358674Disabling compacts and flushes for region at 1676325358674Disabling writes for close at 1676325358674Writing region close event to WAL at 1676325358675 (+1 ms)Running coprocessor post-close hooks at 1676325358678 (+3 ms)Closed at 1676325358678 2023-02-13 21:55:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676325326489.04b9f9298378fddd0e87b95e75732d22. 2023-02-13 21:55:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 3fa3f38521a8386caacc176badb612e8, disabling compactions & flushes 2023-02-13 21:55:58,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. after waiting 0 ms 2023-02-13 21:55:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/ns/testMinorCompaction/3fa3f38521a8386caacc176badb612e8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 3fa3f38521a8386caacc176badb612e8: Waiting for close lock at 1676325358679Running coprocessor pre-close hooks at 1676325358679Disabling compacts and flushes for region at 1676325358679Disabling writes for close at 1676325358679Writing region close event to WAL at 1676325358680 (+1 ms)Running coprocessor post-close hooks at 1676325358682 (+2 ms)Closed at 1676325358682 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676325308721.3fa3f38521a8386caacc176badb612e8. 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing afec7cc7c29021c5831cdc083c828616, disabling compactions & flushes 2023-02-13 21:55:58,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. after waiting 0 ms 2023-02-13 21:55:58,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:55:58,684 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMinorCompactionWithWeeklyPolicy/afec7cc7c29021c5831cdc083c828616/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-13 21:55:58,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for afec7cc7c29021c5831cdc083c828616: Waiting for close lock at 1676325358682Running coprocessor pre-close hooks at 1676325358682Disabling compacts and flushes for region at 1676325358682Disabling writes for close at 1676325358682Writing region close event to WAL at 1676325358683 (+1 ms)Running coprocessor post-close hooks at 1676325358684 (+1 ms)Closed at 1676325358684 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676325218865.afec7cc7c29021c5831cdc083c828616. 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 8f063bcc9162a76c6ed12c6cf5f8ce2f, disabling compactions & flushes 2023-02-13 21:55:58,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. after waiting 0 ms 2023-02-13 21:55:58,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:55:58,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/8f063bcc9162a76c6ed12c6cf5f8ce2f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-13 21:55:58,687 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 8f063bcc9162a76c6ed12c6cf5f8ce2f: Waiting for close lock at 1676325358685Running coprocessor pre-close hooks at 1676325358685Disabling compacts and flushes for region at 1676325358685Disabling writes for close at 1676325358685Writing region close event to WAL at 1676325358685Running coprocessor post-close hooks at 1676325358687 (+2 ms)Closed at 1676325358687 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676325262548.8f063bcc9162a76c6ed12c6cf5f8ce2f. 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 9c44b5c0318571f7361b3af71ed6a4df, disabling compactions & flushes 2023-02-13 21:55:58,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. after waiting 0 ms 2023-02-13 21:55:58,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:58,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/data/default/testMajorCompactionFromAdmin/9c44b5c0318571f7361b3af71ed6a4df/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-13 21:55:58,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:58,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 9c44b5c0318571f7361b3af71ed6a4df: Waiting for close lock at 1676325358688Running coprocessor pre-close hooks at 1676325358688Disabling compacts and flushes for region at 1676325358688Disabling writes for close at 1676325358688Writing region close event to WAL at 1676325358689 (+1 ms)Running coprocessor post-close hooks at 1676325358691 (+2 ms)Closed at 1676325358691 2023-02-13 21:55:58,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676325337663.9c44b5c0318571f7361b3af71ed6a4df. 2023-02-13 21:55:58,744 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 21:55:58,744 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 21:55:58,792 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,34815,1676325186101; all regions closed. 2023-02-13 21:55:58,803 DEBUG [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/oldWALs 2023-02-13 21:55:58,803 INFO [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34815%2C1676325186101.meta:.meta(num 1676325188486) 2023-02-13 21:55:58,809 DEBUG [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/oldWALs 2023-02-13 21:55:58,809 INFO [RS:0;jenkins-hbase20:34815] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C34815%2C1676325186101:(num 1676325187890) 2023-02-13 21:55:58,809 DEBUG [RS:0;jenkins-hbase20:34815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,809 INFO [RS:0;jenkins-hbase20:34815] regionserver.LeaseManager(133): Closed leases 2023-02-13 21:55:58,810 INFO [RS:0;jenkins-hbase20:34815] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 21:55:58,810 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 21:55:58,811 INFO [RS:0;jenkins-hbase20:34815] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:34815 2023-02-13 21:55:58,820 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 21:55:58,820 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,34815,1676325186101 2023-02-13 21:55:58,820 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41dcf436 rejected from java.util.concurrent.ThreadPoolExecutor@45e378d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:58,820 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,34815,1676325186101] 2023-02-13 21:55:58,820 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 21:55:58,821 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1770438f rejected from java.util.concurrent.ThreadPoolExecutor@45e378d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:58,821 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,34815,1676325186101; numProcessing=1 2023-02-13 21:55:58,822 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,34815,1676325186101 already deleted, retry=false 2023-02-13 21:55:58,822 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,34815,1676325186101 expired; onlineServers=0 2023-02-13 21:55:58,822 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,37155,1676325185079' ***** 2023-02-13 21:55:58,822 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 21:55:58,822 DEBUG [M:0;jenkins-hbase20:37155] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4243b9fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-13 21:55:58,822 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,37155,1676325185079 2023-02-13 21:55:58,822 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,37155,1676325185079; all regions closed. 2023-02-13 21:55:58,822 DEBUG [M:0;jenkins-hbase20:37155] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 21:55:58,823 DEBUG [M:0;jenkins-hbase20:37155] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 21:55:58,823 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 21:55:58,823 DEBUG [M:0;jenkins-hbase20:37155] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 21:55:58,823 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676325187635] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676325187635,5,FailOnTimeoutGroup] 2023-02-13 21:55:58,823 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676325187634] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676325187634,5,FailOnTimeoutGroup] 2023-02-13 21:55:58,823 INFO [M:0;jenkins-hbase20:37155] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 21:55:58,823 INFO [M:0;jenkins-hbase20:37155] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 21:55:58,823 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 21:55:58,823 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 21:55:58,823 INFO [M:0;jenkins-hbase20:37155] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-13 21:55:58,823 DEBUG [M:0;jenkins-hbase20:37155] master.HMaster(1502): Stopping service threads 2023-02-13 21:55:58,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 21:55:58,824 INFO [M:0;jenkins-hbase20:37155] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 21:55:58,824 ERROR [M:0;jenkins-hbase20:37155] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-13 21:55:58,825 INFO [M:0;jenkins-hbase20:37155] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 21:55:58,825 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 21:55:58,825 DEBUG [M:0;jenkins-hbase20:37155] zookeeper.ZKUtil(398): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 21:55:58,825 WARN [M:0;jenkins-hbase20:37155] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 21:55:58,825 INFO [M:0;jenkins-hbase20:37155] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 21:55:58,825 INFO [M:0;jenkins-hbase20:37155] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 21:55:58,825 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 21:55:58,825 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:55:58,825 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:55:58,825 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 21:55:58,825 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:55:58,825 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.30 KB heapSize=599.17 KB 2023-02-13 21:55:58,921 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 21:55:58,921 INFO [RS:0;jenkins-hbase20:34815] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,34815,1676325186101; zookeeper connection closed. 2023-02-13 21:55:58,922 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6fd09b23 rejected from java.util.concurrent.ThreadPoolExecutor@45e378d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:58,922 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): regionserver:34815-0x1015dd424a70001, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 21:55:58,922 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@733894d5] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@733894d5 2023-02-13 21:55:58,922 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@75374aef rejected from java.util.concurrent.ThreadPoolExecutor@45e378d5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:58,923 INFO [Listener at localhost.localdomain/39503] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-13 21:55:59,234 INFO [M:0;jenkins-hbase20:37155] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.30 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f37d01595f9043dabfe871af5570a7e0 2023-02-13 21:55:59,246 INFO [M:0;jenkins-hbase20:37155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37d01595f9043dabfe871af5570a7e0 2023-02-13 21:55:59,248 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f37d01595f9043dabfe871af5570a7e0 as hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f37d01595f9043dabfe871af5570a7e0 2023-02-13 21:55:59,253 INFO [M:0;jenkins-hbase20:37155] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f37d01595f9043dabfe871af5570a7e0 2023-02-13 21:55:59,253 INFO [M:0;jenkins-hbase20:37155] regionserver.HStore(1080): Added hdfs://localhost.localdomain:38021/user/jenkins/test-data/d4b2e48c-3b38-7236-ecbd-416c510e23c9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f37d01595f9043dabfe871af5570a7e0, entries=123, sequenceid=1006, filesize=33.3 K 2023-02-13 21:55:59,254 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegion(2947): Finished flush of dataSize ~513.30 KB/525624, heapSize ~599.16 KB/613536, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 429ms, sequenceid=1006, compaction requested=false 2023-02-13 21:55:59,255 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 21:55:59,255 DEBUG [M:0;jenkins-hbase20:37155] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676325358825Disabling compacts and flushes for region at 1676325358825Disabling writes for close at 1676325358825Obtaining lock to block concurrent updates at 1676325358825Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676325358825Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525624, getHeapSize=613536, getOffHeapSize=0, getCellsCount=1161 at 1676325358826 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676325358826Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676325358826Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676325358829 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676325358829Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676325359248 (+419 ms)Finished flush of dataSize ~513.30 KB/525624, heapSize ~599.16 KB/613536, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 429ms, sequenceid=1006, compaction requested=false at 1676325359254 (+6 ms)Writing region close event to WAL at 1676325359255 (+1 ms)Closed at 1676325359255 2023-02-13 21:55:59,257 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 21:55:59,257 INFO [M:0;jenkins-hbase20:37155] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 21:55:59,258 INFO [M:0;jenkins-hbase20:37155] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:37155 2023-02-13 21:55:59,259 DEBUG [M:0;jenkins-hbase20:37155] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,37155,1676325185079 already deleted, retry=false 2023-02-13 21:55:59,361 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 21:55:59,361 INFO [M:0;jenkins-hbase20:37155] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,37155,1676325185079; zookeeper connection closed. 2023-02-13 21:55:59,361 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6e9cd0a0 rejected from java.util.concurrent.ThreadPoolExecutor@2b713958[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:59,361 DEBUG [Listener at localhost.localdomain/39503-EventThread] zookeeper.ZKWatcher(600): master:37155-0x1015dd424a70000, quorum=127.0.0.1:60489, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 21:55:59,362 ERROR [Listener at localhost.localdomain/39503-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1afd393c rejected from java.util.concurrent.ThreadPoolExecutor@2b713958[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 21:55:59,365 WARN [Listener at localhost.localdomain/39503] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 21:55:59,371 INFO [Listener at localhost.localdomain/39503] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 21:55:59,477 WARN [BP-217941048-148.251.75.209-1676325181965 heartbeating to localhost.localdomain/127.0.0.1:38021] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 21:55:59,477 WARN [BP-217941048-148.251.75.209-1676325181965 heartbeating to localhost.localdomain/127.0.0.1:38021] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-217941048-148.251.75.209-1676325181965 (Datanode Uuid bdf589dd-6236-4fca-a0bf-4d069f108059) service to localhost.localdomain/127.0.0.1:38021 2023-02-13 21:55:59,478 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/dfs/data/data1/current/BP-217941048-148.251.75.209-1676325181965] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 21:55:59,479 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/7d412330-af35-6469-a8f0-3f1366560f6d/cluster_71d8bc3a-0275-c5e7-861a-df917b4a47e7/dfs/data/data2/current/BP-217941048-148.251.75.209-1676325181965] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 21:55:59,505 INFO [Listener at localhost.localdomain/39503] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-13 21:55:59,631 INFO [Listener at localhost.localdomain/39503] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 21:55:59,721 INFO [Listener at localhost.localdomain/39503] hbase.HBaseTestingUtility(1293): Minicluster is down